-- Logs begin at Tue 2022-08-23 22:43:15 UTC, end at Tue 2022-08-23 23:38:10 UTC. -- Aug 23 23:10:08.790097 dv-osbrick-853458-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 23 23:10:08.799078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 23 23:10:08.801140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 23:10:08 2022] *** Aug 23 23:10:08.801140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 23:10:08.801140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 23:10:08.801140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: nodename: dv-osbrick-853458-3-iscsi Aug 23 23:10:08.801140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: machine: x86_64 Aug 23 23:10:08.801140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: clock source: unix Aug 23 23:10:08.801140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: pcre jit disabled Aug 23 23:10:08.801140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: detected number of CPU cores: 4 Aug 23 23:10:08.801140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: current working directory: / Aug 23 23:10:08.801140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: detected binary path: /usr/bin/uwsgi-core Aug 23 23:10:08.802374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: your processes number limit is 47680 Aug 23 23:10:08.802374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: your memory page size is 4096 bytes Aug 23 23:10:08.802374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: detected max file descriptor number: 2048 Aug 23 23:10:08.802374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: lock engine: pthread robust mutexes Aug 23 23:10:08.802374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: thunder lock: enabled Aug 23 23:10:08.802374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 23 23:10:08.802374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 23:10:08.840980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: Python main interpreter initialized at 0x5561f1ab49c0 Aug 23 23:10:08.840980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: python threads support enabled Aug 23 23:10:08.840980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: your server socket listen backlog is limited to 100 connections Aug 23 23:10:08.840980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: your mercy for graceful operations on workers is 90 seconds Aug 23 23:10:08.841350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 23:10:08.841428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: *** Operational MODE: preforking *** Aug 23 23:10:08.841676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: *** uWSGI is running in multiple interpreter mode *** Aug 23 23:10:08.841676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: spawned uWSGI master process (pid: 81425) Aug 23 23:10:08.841885 dv-osbrick-853458-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 23 23:10:08.842433 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: spawned uWSGI worker 1 (pid: 81437, cores: 1) Aug 23 23:10:08.842768 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: spawned uWSGI worker 2 (pid: 81438, cores: 1) Aug 23 23:10:08.844876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81425]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 23:10:13.222255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 23:10:13.222255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: from cryptography.utils import int_from_bytes Aug 23 23:10:13.223060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 23:10:13.223060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: from cryptography.utils import int_from_bytes Aug 23 23:10:13.223060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 23:10:13.223060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: from cryptography.utils import int_from_bytes Aug 23 23:10:13.223635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 23:10:13.223635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: from cryptography.utils import int_from_bytes Aug 23 23:10:13.273794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 23:10:13.273977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 23:10:13.274059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 23:10:13.274146 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] command line args: [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 23:10:13.274226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 23:10:13.274347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 23:10:13.274434 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] command line args: [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 23:10:13.274512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ================================================================================ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 23:10:13.274619 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 23:10:13.274765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] admin_token = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.274845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ================================================================================ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 23:10:13.275012 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] config_dir = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.275092 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] admin_token = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.275202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.275288 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] config_dir = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.275385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] config_source = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.275469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.275568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] debug = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.275647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] config_source = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.275770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.277108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] debug = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.277108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.277374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.277457 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.277535 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.277611 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.277737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.277829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.277908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.278026 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.278107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.278185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.278303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] log_config_append = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.278386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] log_config_append = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.278503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.278584 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.278706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] log_dir = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.278788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] log_dir = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.278909 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] log_file = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.278993 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] log_file = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.279072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.279187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.279261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.279382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.279458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.279582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.279659 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.279739 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.279857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.279939 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.280067 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.280152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.280276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.280352 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.280468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.280557 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.280676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.280802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.280884 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.280956 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.281070 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.281151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.281235 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.281313 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.281434 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.281526 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.281598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.281714 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.281797 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.281876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.281994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.107/identity {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.282070 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.107/identity {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.282193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] publish_errors = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.282275 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] publish_errors = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.282397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.282474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.282601 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.282683 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.282755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.282824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.282897 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.282985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.283068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.283141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.283210 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] standard_threads = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.283280 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] standard_threads = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.283359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.283436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.283508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.283577 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.283693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.283769 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.283890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] use_journal = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.283965 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] use_journal = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.284035 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] use_json = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.284105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] use_json = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.284181 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] use_stderr = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.284253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] use_stderr = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.284334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] use_syslog = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.284412 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] use_syslog = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.284488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.284616 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:10:13.284772 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.284884 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.285015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.285126 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.285277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.285389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.285519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.285654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.285797 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.286039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.286121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.286212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.286341 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.286453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.286536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.286609 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.286739 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.286847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.286988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.287099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.287239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.287368 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.287475 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.287554 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.287724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.287846 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.287969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.288101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.288223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.288338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.288457 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.288584 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.288745 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.288862 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.289223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.289346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.289462 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.289656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.289773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.289895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.290009 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.290129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.290243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.290368 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.290484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.290597 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.290710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.290829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.290951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.291074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.291190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.291309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.291424 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.291536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.291656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.291782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.291898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.292022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.292137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.292250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.292369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.292493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.292674 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.292792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.292905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.293020 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.293133 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.293255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.293370 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.293483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.293596 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.293708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.293820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.293942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.294064 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.294178 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.294291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.294404 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.294522 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.294646 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.294761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.294874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.294988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.295101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.295214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.295403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.295527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.295642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.295755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.295868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.295981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.296103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.296226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.296347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.296467 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.296582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.296724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.296851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.296967 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.297064 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.297160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.297254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.297356 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.297508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.297605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.297706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.297802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.297903 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.298010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.298126 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.298231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.298335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.298490 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.298646 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.298776 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.298893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.299036 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.299152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.299273 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.299379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.299500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.299617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.299721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.299832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.299945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.300068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.300197 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.300326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.300455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.300572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.300733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.300838 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.300951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.301066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.301193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.301849 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.301978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.302197 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.302330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.302446 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.302570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.302687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.302792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.302904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.303018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.303122 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.303243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.303348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.303461 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.303575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.303689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.303802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.303925 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.304041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.304155 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.304278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.304511 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.304655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.304786 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.304904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.305020 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.305134 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.305248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.305362 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.305486 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.305603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.305718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.305831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.305945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.306060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.306185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.306301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.306416 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.306530 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.306645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.306759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.306885 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.307002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.307116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.307229 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.307343 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.307495 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.307693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.307813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.307928 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.308042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.308156 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.308283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.308409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.308523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.308678 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.308796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.308912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.309039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.309156 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.309279 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.309395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.309509 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.309623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.309746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.309863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.309986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.310103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.310217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.310331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.310445 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.310559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.310681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.310797 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.external = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.310911 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.external = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.311025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.311139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.311253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.311405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.311532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.311658 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.311775 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.password = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.311903 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.password = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.312020 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.token = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.312135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.token = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.312249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.312372 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.312489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.312618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.312737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.312852 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.312968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.313100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.313219 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.313335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.313450 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.313565 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.313680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.313803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.313928 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.314046 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.314162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.314276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.314392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.314517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.314635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.314750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.314865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.314985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.315103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.315226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.315350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.315468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.315583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.315697 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.315812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.315937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.316061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.316178 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.316294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.316408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.316532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.316689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.316808 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.317635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.317796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.317967 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.318104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.318224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.318340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.318462 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.318580 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.318695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.318819 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.318937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.318937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.319153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.319153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.319369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.319493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.319611 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.319726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.319726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.319952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.319952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.320178 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.320178 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.320397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.320513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.320652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.320771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.320899 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.321016 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.321131 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.321246 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.321362 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.321477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.321601 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.321719 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.321838 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.321953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.322084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.322201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.322392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.322512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.322628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.322743 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.322858 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.322973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.323099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.323216 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.323315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.323430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.323545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.323660 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.323784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.323908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.324024 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.324140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.324255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.324370 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.324495 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.324627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.324755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.324873 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.324988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.325104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.325228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.325346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.325461 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.325577 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.325691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.325815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.325932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.326048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.326163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.326278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.326393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.326516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.326634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.326749 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.326864 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.326979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.327094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.327217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.327334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.327449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.327564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.327720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.327840 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.327966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.328083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.328198 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.328314 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.328429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.328555 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.328716 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.328835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.328950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.329101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.329225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.329341 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.329465 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.329582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.329698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.329813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.329927 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.330042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.330166 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.330284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.330398 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.330513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.330513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.330728 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.330728 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.330953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.331068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.331190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.331306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.331420 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.331543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.331660 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.331779 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.331894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.332008 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.332122 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.332245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.332363 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.332477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.332679 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.332779 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.332894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.333023 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.333141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.333256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.333371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.333492 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.333609 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.333732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.333851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.333974 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.334091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.334206 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.334206 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.334429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.334546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.334661 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.334776 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.334890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.335005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.335128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.335244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.335358 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.335473 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.335587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.335701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.335825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.335941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.336057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.336172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.336286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.336400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.336523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.336682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.336799 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.336915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.337031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.337146 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.337273 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.337391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.337506 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.337620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.337772 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.337898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.338024 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.338142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.338258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.338373 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.338488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.338603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.338727 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.338843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.338958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.339080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.339198 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.339312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.339436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.339553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.339668 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.339783 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.339898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.340013 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.340137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.340255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.340360 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.340473 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.340588 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.340719 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.340852 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.340970 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.341085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.341206 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.341323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.341446 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.341563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.341678 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.341796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.341912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.342026 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.342150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.342267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.342382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.342496 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.342611 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.342725 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.342848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.342965 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.343080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.343195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.343310 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.343408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.343530 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.343631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.343745 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.343860 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.344239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.344360 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.344486 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.344623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.344741 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] role.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.344856 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.344972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] role.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.345087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.345281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.345401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] role.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.345518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.345633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] role.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.345749 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.345865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.345991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.346109 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.346224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.346339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.346455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.346570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.346694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.346811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.346926 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.347042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.347163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.347279 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.347402 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.347520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.347636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.347750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.347898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.348017 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.348162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.348317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.348438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.348556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.348556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.348841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.348969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.349087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.349087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.349300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.349415 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.349538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.349655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.349769 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.349884 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.349999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.350113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.350236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.350353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.350468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.350582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.350697 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.350811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.350934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.351050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.351165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.351279 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.351394 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.351508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.351631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.351753 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.351868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.351982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.352096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.352210 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.352333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.352449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.352563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.352699 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.352815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.352929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.353060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.353178 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] token.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.353293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.353408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.353523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.353638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.353762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] token.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.353880 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.353994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.354109 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.354223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.354337 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.354460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.354576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.354692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.354806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.354922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.355037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.355160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.355277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.355392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.355506 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.355621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.355735 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.355735 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.355963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.356078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.356193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.356193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.356406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.356406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.356695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.356814 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.356929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.356929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.357144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.357272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.357389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.357514 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.357639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.357756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.357877 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.357877 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.358145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.358271 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.358403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.358521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.358636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.358751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.358865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.358979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.359104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.359220 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.359335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.359449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.359563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.359677 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.359800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.359917 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.360031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.360146 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.360267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.360383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.360507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.360637 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.360754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.360869 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.360984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.361098 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.361225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.361343 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.361464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.361581 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.361699 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.361823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 23:10:13.361941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.361941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.361941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:10:13.361941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 23:10:13.396127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.396414 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.396674 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.398101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.398338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.398564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.405318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.407026 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.434802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.435027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.436317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.436549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.489148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.489391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.538896 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.539425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.539559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.539559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.698692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.698883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.699027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.699114 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.699226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.699311 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.699387 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.699460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.699533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.699614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.699741 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.699826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.722920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.723667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.723809 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.723969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.724090 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.724176 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.724297 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.724379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.724500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.724585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.724686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.724802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.724887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.725019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.737792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.737986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.754570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.754798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.755025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.755251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.755471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.755641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.755727 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.755878 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.755971 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.756107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.756331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.756551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.756792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.757012 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:10:13.772785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.772978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 23:10:13.773327 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.773410 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.773532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 23:10:13.773617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 23:10:13.773809 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.773890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.774065 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 23:10:13.774146 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.774345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.774596 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.774679 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.774868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.775114 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.775380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.784342 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.784655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.784790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.784933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.785073 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.785222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.785348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.786158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.793211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.793415 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.796173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.796529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.796694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.796827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.796960 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.797091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.797246 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.797378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.797508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.797635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.797759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.797897 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.798034 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.798164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.798292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.798421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.798557 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.798696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.798824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.798952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.799079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.799214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.822184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.823453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.823644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.823930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.824965 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.825256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.828657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.828912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.829196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.830498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.830787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.831077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.835739 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.836027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.837696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.837942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.840145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.840440 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.840752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.841039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.841319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.841599 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.841879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.842076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.842203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.842375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.842666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.842956 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.843239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.843522 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.843801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.844079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.860496 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.860814 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.863664 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.864785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.865268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.868487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.868821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.870320 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.873048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.874795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.875107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.876438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.879432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.880115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.880423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.880743 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.881037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.881326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.881628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.882769 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.886064 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.886371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.886663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.886956 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.887243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.887538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.897804 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.898115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.898390 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.898659 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.903730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.904035 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.904335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.904629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.905568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.907088 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.907369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.910035 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.910327 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.911150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.911457 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.911738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.912090 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.913650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.913936 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.916889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.917177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.917478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.917778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.918063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.923427 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.923711 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.923996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.924280 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.924564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.924867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.925149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.930104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.930394 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.930681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.930968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.931256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.931541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.931825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.941308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.944668 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.947500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.947647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.949032 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.950512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.950673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.950797 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.951096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.953634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.955090 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.956571 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.956883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.957181 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.957637 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.959096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.962077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.962379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.962674 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.962963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.963932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.965421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.968483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.968816 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.969105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.969395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.970887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.971183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.971470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.977904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.978213 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.978502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.978917 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.979203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.979489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.979770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.980048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.980334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.980629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.980938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.981195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.981478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.981760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.982034 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.982311 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.982580 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.985465 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:10:13.985757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.986046 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.986369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.986654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.986904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.987183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.987480 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.987766 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.988019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.988304 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.988664 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.989567 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:13.989746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:10:14.017720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5561f1ab49c0 pid: 81437 (default app) Aug 23 23:10:14.021828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8a2ed-5c2e-4ee0-9d04-d41b176041ad None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:14.022114 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8a2ed-5c2e-4ee0-9d04-d41b176041ad None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:14.022393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8a2ed-5c2e-4ee0-9d04-d41b176041ad None None] PATH_INFO: `/v3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:14.025403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5561f1ab49c0 pid: 81438 (default app) Aug 23 23:10:14.026567 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1/1] 10.222.0.107 () {50 vars in 796 bytes} [Tue Aug 23 23:10:14 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:20.728794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6e955-bc16-4367-a723-a1dd93c4433f None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:20.729310 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6e955-bc16-4367-a723-a1dd93c4433f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:20.729310 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6e955-bc16-4367-a723-a1dd93c4433f None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:20.733552 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1/2] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:20 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:10:20.741133 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f8ce9-caa8-491c-9bc1-ff6d479625ad None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:20.741531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f8ce9-caa8-491c-9bc1-ff6d479625ad None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:20.741676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f8ce9-caa8-491c-9bc1-ff6d479625ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:20.812293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: INFO dbcounter [None req-da5f8ce9-caa8-491c-9bc1-ff6d479625ad None None] Registered counter for database keystone Aug 23 23:10:20.831533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG oslo_db.sqlalchemy.engines [None req-da5f8ce9-caa8-491c-9bc1-ff6d479625ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 23:10:20.838587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writer thread running {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 23:10:21.023900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG passlib.handlers.bcrypt [None req-da5f8ce9-caa8-491c-9bc1-ff6d479625ad None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81437) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 23:10:21.024335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG passlib.handlers.bcrypt [None req-da5f8ce9-caa8-491c-9bc1-ff6d479625ad None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81437) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 23:10:21.079241 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-da5f8ce9-caa8-491c-9bc1-ff6d479625ad None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:21.080878 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-da5f8ce9-caa8-491c-9bc1-ff6d479625ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:21.212721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 2/3] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:20 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 23 23:10:21.682375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6e955-bc16-4367-a723-a1dd93c4433f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:21.750875 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: INFO dbcounter [None req-2cf6e955-bc16-4367-a723-a1dd93c4433f None None] Registered counter for database keystone Aug 23 23:10:21.773150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG oslo_db.sqlalchemy.engines [None req-2cf6e955-bc16-4367-a723-a1dd93c4433f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 23:10:21.779356 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writer thread running {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 23:10:21.900748 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6e955-bc16-4367-a723-a1dd93c4433f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:21.905694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d4c74-8e81-4bbf-bb49-92d412debe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:21.906319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d4c74-8e81-4bbf-bb49-92d412debe09 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:21.906655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d4c74-8e81-4bbf-bb49-92d412debe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:21.906922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d4c74-8e81-4bbf-bb49-92d412debe09 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:21.916375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d4c74-8e81-4bbf-bb49-92d412debe09 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:21.969795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6f6d4c74-8e81-4bbf-bb49-92d412debe09 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 23:10:21.970140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d4c74-8e81-4bbf-bb49-92d412debe09 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:21.980866 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 2/4] 10.222.0.107 () {58 vars in 1329 bytes} [Tue Aug 23 23:10:21 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:10:21.986838 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f8ce9-caa8-491c-9bc1-ff6d479625ad None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:22.002818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f8ce9-caa8-491c-9bc1-ff6d479625ad None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:22.007788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec036d-7f1f-44c0-87fa-985244a9d2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:22.008937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec036d-7f1f-44c0-87fa-985244a9d2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:22.009221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec036d-7f1f-44c0-87fa-985244a9d2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:22.009494 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec036d-7f1f-44c0-87fa-985244a9d2c3 admin admin] PATH_INFO: `/v3/projects/2ab98da0af85419a9eb4e9e222c7d0ea` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:22.011087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec036d-7f1f-44c0-87fa-985244a9d2c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=2ab98da0af85419a9eb4e9e222c7d0ea)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:22.064730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9dec036d-7f1f-44c0-87fa-985244a9d2c3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 23:10:22.065079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec036d-7f1f-44c0-87fa-985244a9d2c3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:22.070235 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 3/5] 10.222.0.107 () {56 vars in 1212 bytes} [Tue Aug 23 23:10:21 2022] GET /identity/v3/projects/2ab98da0af85419a9eb4e9e222c7d0ea => generated 345 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:23.977967 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6815fd-b2e2-466e-be78-ad44109a351f None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:23.978507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6815fd-b2e2-466e-be78-ad44109a351f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:23.978507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6815fd-b2e2-466e-be78-ad44109a351f None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:23.982624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 3/6] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:23 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:23.988240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e79041-a227-488d-831b-95349dd18baf None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:23.988704 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e79041-a227-488d-831b-95349dd18baf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:23.988825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e79041-a227-488d-831b-95349dd18baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:24.009782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-06e79041-a227-488d-831b-95349dd18baf None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:24.011310 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-06e79041-a227-488d-831b-95349dd18baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:24.019069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 4/7] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:23 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 23:10:24.289612 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6815fd-b2e2-466e-be78-ad44109a351f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:24.303832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6815fd-b2e2-466e-be78-ad44109a351f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:24.308099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aaac5f-4987-4286-bfe6-f3701909b071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:24.308776 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaac5f-4987-4286-bfe6-f3701909b071 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:24.309060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaac5f-4987-4286-bfe6-f3701909b071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:24.309336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaac5f-4987-4286-bfe6-f3701909b071 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:24.317237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aaac5f-4987-4286-bfe6-f3701909b071 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:24.319119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aaac5f-4987-4286-bfe6-f3701909b071 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:24.327912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 4/8] 10.222.0.107 () {58 vars in 1329 bytes} [Tue Aug 23 23:10:24 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:10:24.333624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e79041-a227-488d-831b-95349dd18baf None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:24.342813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e79041-a227-488d-831b-95349dd18baf None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:24.347184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e97bd-737d-4a39-b6c2-24f9c1c1dc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:24.347810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e97bd-737d-4a39-b6c2-24f9c1c1dc20 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:24.348088 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e97bd-737d-4a39-b6c2-24f9c1c1dc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:24.349038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e97bd-737d-4a39-b6c2-24f9c1c1dc20 admin admin] PATH_INFO: `/v3/users/7dbee4330ce74aedb00eece717c969c5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:24.350405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e97bd-737d-4a39-b6c2-24f9c1c1dc20 admin admin] RBAC: Authorizing `identity:get_user(user_id=7dbee4330ce74aedb00eece717c969c5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:24.352254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e97bd-737d-4a39-b6c2-24f9c1c1dc20 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:24.353829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 5/9] 10.222.0.107 () {56 vars in 1203 bytes} [Tue Aug 23 23:10:24 2022] GET /identity/v3/users/7dbee4330ce74aedb00eece717c969c5 => generated 248 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:26.330606 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382e2fc-4a4e-4391-b92c-cc910d31be57 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:26.331129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382e2fc-4a4e-4391-b92c-cc910d31be57 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:26.331129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382e2fc-4a4e-4391-b92c-cc910d31be57 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:26.332380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 5/10] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:10:26.338217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23485b77-0a54-45bc-87c7-9043066a64cd None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:26.338637 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23485b77-0a54-45bc-87c7-9043066a64cd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:26.338841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23485b77-0a54-45bc-87c7-9043066a64cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:26.357644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-23485b77-0a54-45bc-87c7-9043066a64cd None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:26.358840 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-23485b77-0a54-45bc-87c7-9043066a64cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:26.382074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c93b46-2539-4db4-9583-8367bb28e1a1 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:26.382353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c93b46-2539-4db4-9583-8367bb28e1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:26.382626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c93b46-2539-4db4-9583-8367bb28e1a1 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:26.383936 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 6/11] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:10:26.388924 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5e7b5-a5fd-41ce-acf6-ca6b39274e74 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:26.389237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5e7b5-a5fd-41ce-acf6-ca6b39274e74 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:26.389499 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5e7b5-a5fd-41ce-acf6-ca6b39274e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:26.434163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG passlib.handlers.bcrypt [None req-0ee5e7b5-a5fd-41ce-acf6-ca6b39274e74 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81438) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 23:10:26.434584 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG passlib.handlers.bcrypt [None req-0ee5e7b5-a5fd-41ce-acf6-ca6b39274e74 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81438) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 23:10:26.443057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 6/12] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:26.481419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0ee5e7b5-a5fd-41ce-acf6-ca6b39274e74 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:26.483058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0ee5e7b5-a5fd-41ce-acf6-ca6b39274e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:26.586138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 7/13] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:10:26.724278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23485b77-0a54-45bc-87c7-9043066a64cd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:26.748997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:26.832209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23485b77-0a54-45bc-87c7-9043066a64cd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:26.853968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5e7b5-a5fd-41ce-acf6-ca6b39274e74 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:26.866604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4b424-1964-4b24-b671-6253c5c47ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:26.867508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4b424-1964-4b24-b671-6253c5c47ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:26.867508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4b424-1964-4b24-b671-6253c5c47ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:26.867803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4b424-1964-4b24-b671-6253c5c47ef6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:26.879149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4b424-1964-4b24-b671-6253c5c47ef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:26.889287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f9d4b424-1964-4b24-b671-6253c5c47ef6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:10:26.889287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:26.889287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:26.889287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:26.889287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:26.889287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:26.889287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:26.889287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:26.889287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:26.889287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:26.889287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:26.889287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:26.889287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:26.889287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:26.889287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:26.889287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:26.890291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:26.890291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:26.890291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:26.890291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:26.890291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:26.890291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:26.890291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:26.890291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:26.890291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:26.890291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:26.890291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:26.890291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:26.890291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:26.890291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:26.890291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:26.890291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:26.891283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:26.891283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:26.891283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:26.891283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:26.891283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:26.891283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:26.891283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:26.891283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:26.891283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:26.891283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:26.891283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:10:26.891283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:10:26.891283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 7/14] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:10:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:26.896338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4b424-1964-4b24-b671-6253c5c47ef6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:26.968428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5e7b5-a5fd-41ce-acf6-ca6b39274e74 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:26.970718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:26.983617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:27.004360 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4b424-1964-4b24-b671-6253c5c47ef6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:27.008404 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a91bd4-b66d-42e1-aa26-70112e48f486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:27.009307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a91bd4-b66d-42e1-aa26-70112e48f486 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:27.009588 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a91bd4-b66d-42e1-aa26-70112e48f486 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:27.009862 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a91bd4-b66d-42e1-aa26-70112e48f486 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:27.039706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e61d48-369f-41a2-8ce7-e23741db1aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:27.040318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e61d48-369f-41a2-8ce7-e23741db1aea None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:27.040619 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e61d48-369f-41a2-8ce7-e23741db1aea None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:27.040903 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e61d48-369f-41a2-8ce7-e23741db1aea None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:27.041581 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e61d48-369f-41a2-8ce7-e23741db1aea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:27.041882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e61d48-369f-41a2-8ce7-e23741db1aea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:27.043275 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e61d48-369f-41a2-8ce7-e23741db1aea None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:27.055717 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 8/15] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:10:26 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:10:27.061418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e61d48-369f-41a2-8ce7-e23741db1aea None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:27.079047 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a91bd4-b66d-42e1-aa26-70112e48f486 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:27.080661 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a91bd4-b66d-42e1-aa26-70112e48f486 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:27.165387 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e61d48-369f-41a2-8ce7-e23741db1aea None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:27.182831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 8/16] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:10:26 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:10:27.188420 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a91bd4-b66d-42e1-aa26-70112e48f486 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:27.191246 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:27.200841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e485fe4-30c2-4924-aaaf-dd03b5992575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:27.201483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e485fe4-30c2-4924-aaaf-dd03b5992575 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:27.201760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e485fe4-30c2-4924-aaaf-dd03b5992575 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:27.202143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e485fe4-30c2-4924-aaaf-dd03b5992575 None admin] PATH_INFO: `/v3/users/7dbee4330ce74aedb00eece717c969c5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:27.203193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e485fe4-30c2-4924-aaaf-dd03b5992575 None admin] RBAC: Authorizing `identity:get_user(user_id=7dbee4330ce74aedb00eece717c969c5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:27.204723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e485fe4-30c2-4924-aaaf-dd03b5992575 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:27.208675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 9/17] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:27 2022] GET /identity/v3/users/7dbee4330ce74aedb00eece717c969c5 => generated 248 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:27.215052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e485fe4-30c2-4924-aaaf-dd03b5992575 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:27.231410 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:27.297214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a91bd4-b66d-42e1-aa26-70112e48f486 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:27.324746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e485fe4-30c2-4924-aaaf-dd03b5992575 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:27.332136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73d70b-c11d-4146-a580-3e279e4e31f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:27.333634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73d70b-c11d-4146-a580-3e279e4e31f2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:27.333912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73d70b-c11d-4146-a580-3e279e4e31f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:27.334184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73d70b-c11d-4146-a580-3e279e4e31f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:27.352636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73d70b-c11d-4146-a580-3e279e4e31f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:27.354138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73d70b-c11d-4146-a580-3e279e4e31f2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:27.359311 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd80ca-76d1-409e-b34c-99b9611e0e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:27.359931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd80ca-76d1-409e-b34c-99b9611e0e8e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:27.360206 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd80ca-76d1-409e-b34c-99b9611e0e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:27.360479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd80ca-76d1-409e-b34c-99b9611e0e8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:27.361615 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd80ca-76d1-409e-b34c-99b9611e0e8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:27.363053 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd80ca-76d1-409e-b34c-99b9611e0e8e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:27.364995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 10/18] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:10:27 2022] GET /identity/v3/domains/default => generated 200 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:10:27.370394 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd80ca-76d1-409e-b34c-99b9611e0e8e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:27.372488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ea73d70b-c11d-4146-a580-3e279e4e31f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:10:27.372488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:27.372488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:27.372488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:27.372488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:27.372488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:27.372488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:27.372488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:27.372488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:27.372488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:27.372488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:27.372488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:27.372488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:10:27.372488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:10:27.372488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:10:27.372488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:10:27.373428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:27.373428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:27.373428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:27.373428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:27.373428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:27.373428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:27.373428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:27.373428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:27.373428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:27.373428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:27.373428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:27.373428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:27.373428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:27.373428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:27.373428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:27.373428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:27.373428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:10:27.374451 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:10:27.374451 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:10:27.374451 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:10:27.374451 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 9/19] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:10:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:10:27.379202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73d70b-c11d-4146-a580-3e279e4e31f2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:27.437450 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:27.453926 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:27.474079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd80ca-76d1-409e-b34c-99b9611e0e8e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:27.483495 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73d70b-c11d-4146-a580-3e279e4e31f2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:27.508106 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c4bfa-1c20-4650-88b0-20b1b8cc26ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:27.508829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4bfa-1c20-4650-88b0-20b1b8cc26ea None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:27.509113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4bfa-1c20-4650-88b0-20b1b8cc26ea None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:27.509385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4bfa-1c20-4650-88b0-20b1b8cc26ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:27.510113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c4bfa-1c20-4650-88b0-20b1b8cc26ea None admin] RBAC: Adding query filter params (role.id=97ece22f2e264e0e857d5107325a85d9, scope.domain.id=default, user.id=7dbee4330ce74aedb00eece717c969c5) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:27.510418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c4bfa-1c20-4650-88b0-20b1b8cc26ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:27.511856 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c4bfa-1c20-4650-88b0-20b1b8cc26ea None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:27.517204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640be4a5-062e-44b8-aa7b-e8586a0b832e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:27.517818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640be4a5-062e-44b8-aa7b-e8586a0b832e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:27.518131 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640be4a5-062e-44b8-aa7b-e8586a0b832e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:27.518380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640be4a5-062e-44b8-aa7b-e8586a0b832e None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:27.518646 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 11/20] 10.222.0.107 () {56 vars in 1327 bytes} [Tue Aug 23 23:10:27 2022] GET /identity/v3/role_assignments?user.id=7dbee4330ce74aedb00eece717c969c5&scope.domain.id=default&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 234 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:10:27.519106 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640be4a5-062e-44b8-aa7b-e8586a0b832e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:27.519416 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640be4a5-062e-44b8-aa7b-e8586a0b832e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:27.521823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640be4a5-062e-44b8-aa7b-e8586a0b832e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:27.543381 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 10/21] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:10:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:10:29.857966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377f7ea-9512-453d-b7ee-acd34a813b3f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:29.858975 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377f7ea-9512-453d-b7ee-acd34a813b3f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:29.859485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377f7ea-9512-453d-b7ee-acd34a813b3f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:29.861059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 12/22] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:29.873884 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac01785-a472-42dd-8ad1-23aca6adacf5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:29.874833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac01785-a472-42dd-8ad1-23aca6adacf5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:29.875301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac01785-a472-42dd-8ad1-23aca6adacf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:29.901032 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0ac01785-a472-42dd-8ad1-23aca6adacf5 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:29.902551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0ac01785-a472-42dd-8ad1-23aca6adacf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:30.000641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a8bd6-5533-4a58-a30e-8693d5142f87 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:30.001180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a8bd6-5533-4a58-a30e-8693d5142f87 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:30.001697 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a8bd6-5533-4a58-a30e-8693d5142f87 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:30.003217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 13/23] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:10:30.004947 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 11/24] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:10:30.019381 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d2de1-c893-4bf6-b764-84cdee5ac1a9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:30.020845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d2de1-c893-4bf6-b764-84cdee5ac1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:30.021329 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d2de1-c893-4bf6-b764-84cdee5ac1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:30.041714 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-af8d2de1-c893-4bf6-b764-84cdee5ac1a9 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:30.043298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-af8d2de1-c893-4bf6-b764-84cdee5ac1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:30.108437 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd264c67-7265-4960-a6b9-94a41b102e60 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:30.109068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd264c67-7265-4960-a6b9-94a41b102e60 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:30.109540 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd264c67-7265-4960-a6b9-94a41b102e60 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:30.111145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 12/25] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:10:30.130242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bb18f-31a9-4c25-a161-1ad4c92ead8f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:30.130853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bb18f-31a9-4c25-a161-1ad4c92ead8f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:30.131412 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bb18f-31a9-4c25-a161-1ad4c92ead8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:30.147898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 14/26] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:30.154079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-235bb18f-31a9-4c25-a161-1ad4c92ead8f None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:30.155513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-235bb18f-31a9-4c25-a161-1ad4c92ead8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:30.201153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:30.228094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 13/27] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 23 23:10:30.354169 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d2de1-c893-4bf6-b764-84cdee5ac1a9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:30.441542 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:30.477569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d2de1-c893-4bf6-b764-84cdee5ac1a9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:30.532424 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f429c0c-b2d7-4c58-80d2-4e9186482acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:30.533096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f429c0c-b2d7-4c58-80d2-4e9186482acc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:30.533378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f429c0c-b2d7-4c58-80d2-4e9186482acc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:30.533653 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f429c0c-b2d7-4c58-80d2-4e9186482acc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:30.548402 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f429c0c-b2d7-4c58-80d2-4e9186482acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:30.549936 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f429c0c-b2d7-4c58-80d2-4e9186482acc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:30.573851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4f429c0c-b2d7-4c58-80d2-4e9186482acc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:10:30.573851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:30.573851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:30.573851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:30.573851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:30.573851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:30.573851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:30.573851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:30.573851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:30.573851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:30.573851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:30.573851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:30.573851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:10:30.573851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:10:30.573851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:10:30.573851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:10:30.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:30.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:30.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:30.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:30.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:30.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:30.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:30.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:30.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:30.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:30.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:30.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:30.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:30.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:30.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:30.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:30.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:10:30.575534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:10:30.575534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:10:30.575534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:10:30.575534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 15/28] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:30.581084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bb18f-31a9-4c25-a161-1ad4c92ead8f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:30.703419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bb18f-31a9-4c25-a161-1ad4c92ead8f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:30.739408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f429c0c-b2d7-4c58-80d2-4e9186482acc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:30.761454 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d0d95-7f0a-4f06-a5d0-b3c202c49661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:30.762088 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d0d95-7f0a-4f06-a5d0-b3c202c49661 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:30.762369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d0d95-7f0a-4f06-a5d0-b3c202c49661 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:30.762644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d0d95-7f0a-4f06-a5d0-b3c202c49661 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:30.763296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d0d95-7f0a-4f06-a5d0-b3c202c49661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:30.763600 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d0d95-7f0a-4f06-a5d0-b3c202c49661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:30.765030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d0d95-7f0a-4f06-a5d0-b3c202c49661 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:30.787732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 14/29] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:10:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:30.788583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d0d95-7f0a-4f06-a5d0-b3c202c49661 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:30.829407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:30.888566 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f429c0c-b2d7-4c58-80d2-4e9186482acc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:30.896763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d0d95-7f0a-4f06-a5d0-b3c202c49661 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:30.919335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:30.928985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd40cc-80a6-4b61-89bb-ff11ff05156b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:30.930023 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd40cc-80a6-4b61-89bb-ff11ff05156b None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:30.930582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd40cc-80a6-4b61-89bb-ff11ff05156b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:30.931060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd40cc-80a6-4b61-89bb-ff11ff05156b None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:30.931927 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd40cc-80a6-4b61-89bb-ff11ff05156b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:30.933609 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd40cc-80a6-4b61-89bb-ff11ff05156b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:30.935494 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bc2ea-e8e9-4600-9f77-698e2318e98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:30.936134 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bc2ea-e8e9-4600-9f77-698e2318e98c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:30.936415 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bc2ea-e8e9-4600-9f77-698e2318e98c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:30.936717 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bc2ea-e8e9-4600-9f77-698e2318e98c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:30.950450 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bc2ea-e8e9-4600-9f77-698e2318e98c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:30.957293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-3f3bc2ea-e8e9-4600-9f77-698e2318e98c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:10:30.957293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:30.957293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:30.957293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:30.957293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:30.957293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:30.957293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:30.957293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:30.957293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:30.957293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:30.957293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:30.957293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:30.957293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:30.957293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:30.957293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:30.957293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:30.958826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:30.958826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:30.958826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:30.958826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:30.958826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:30.958826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:30.958826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:30.958826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:30.958826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:30.958826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:30.958826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:30.958826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:30.958826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:30.958826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:30.958826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:30.958826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:30.959698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:30.959698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:30.959698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:30.959698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:30.959698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:30.959698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:30.959698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:30.959698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:30.959698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:30.959698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:30.959698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:10:30.959698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:10:30.959698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 15/30] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:10:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:30.970223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bc2ea-e8e9-4600-9f77-698e2318e98c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:31.078460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:31.085250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bc2ea-e8e9-4600-9f77-698e2318e98c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:31.085969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 16/31] 10.222.0.107 () {60 vars in 1136 bytes} [Tue Aug 23 23:10:30 2022] POST /identity/v3/roles => generated 220 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:10:31.087923 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac66387-a305-490f-b6a6-d2704338927f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:31.088433 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac66387-a305-490f-b6a6-d2704338927f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:31.089004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac66387-a305-490f-b6a6-d2704338927f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:31.090561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 17/32] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:31.091585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac66387-a305-490f-b6a6-d2704338927f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:31.148256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69664198-3695-4ff3-9749-654c95f5a1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:31.149324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69664198-3695-4ff3-9749-654c95f5a1a6 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:31.149324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69664198-3695-4ff3-9749-654c95f5a1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:31.149569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69664198-3695-4ff3-9749-654c95f5a1a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:31.150469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69664198-3695-4ff3-9749-654c95f5a1a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:31.151962 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69664198-3695-4ff3-9749-654c95f5a1a6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:31.252686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac66387-a305-490f-b6a6-d2704338927f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:31.330477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 16/33] 10.222.0.107 () {60 vars in 1146 bytes} [Tue Aug 23 23:10:30 2022] POST /identity/v3/projects => generated 302 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:10:31.331815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fde75-b873-430a-907b-6a61b987fcb5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:31.332110 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fde75-b873-430a-907b-6a61b987fcb5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:31.332432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fde75-b873-430a-907b-6a61b987fcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:31.354534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b25fde75-b873-430a-907b-6a61b987fcb5 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:31.356278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b25fde75-b873-430a-907b-6a61b987fcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:31.367087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecfeac-61f5-4624-84d1-0c1f4e98a13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:31.368110 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecfeac-61f5-4624-84d1-0c1f4e98a13b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:31.368405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecfeac-61f5-4624-84d1-0c1f4e98a13b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:31.368709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecfeac-61f5-4624-84d1-0c1f4e98a13b None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:31.369823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecfeac-61f5-4624-84d1-0c1f4e98a13b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:31.370417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecfeac-61f5-4624-84d1-0c1f4e98a13b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:31.372208 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecfeac-61f5-4624-84d1-0c1f4e98a13b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:31.393284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 18/34] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:10:31 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:31.401344 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecfeac-61f5-4624-84d1-0c1f4e98a13b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:31.482519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 17/35] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:31.513084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:31.552951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecfeac-61f5-4624-84d1-0c1f4e98a13b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:31.590924 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7de5b-f855-45fa-97f6-4ea0aa4d0fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:31.591591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7de5b-f855-45fa-97f6-4ea0aa4d0fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:31.591871 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7de5b-f855-45fa-97f6-4ea0aa4d0fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:31.592150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7de5b-f855-45fa-97f6-4ea0aa4d0fd9 None admin] PATH_INFO: `/v3/users/7dbee4330ce74aedb00eece717c969c5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:31.593444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7de5b-f855-45fa-97f6-4ea0aa4d0fd9 None admin] RBAC: Authorizing `identity:get_user(user_id=7dbee4330ce74aedb00eece717c969c5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:31.594890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7de5b-f855-45fa-97f6-4ea0aa4d0fd9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:31.596853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 19/36] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:31 2022] GET /identity/v3/users/7dbee4330ce74aedb00eece717c969c5 => generated 248 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:31.603443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fde75-b873-430a-907b-6a61b987fcb5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:31.621121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93486476-4a0f-4ca6-8d6e-e1dbc96f9e44 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:31.621544 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93486476-4a0f-4ca6-8d6e-e1dbc96f9e44 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:31.621914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93486476-4a0f-4ca6-8d6e-e1dbc96f9e44 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:31.624044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 20/37] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:10:31.629291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe2f2a-9410-4238-a091-bd76095574c7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:31.629641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe2f2a-9410-4238-a091-bd76095574c7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:31.629943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe2f2a-9410-4238-a091-bd76095574c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:31.657425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5bbe2f2a-9410-4238-a091-bd76095574c7 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:31.660130 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5bbe2f2a-9410-4238-a091-bd76095574c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:31.714038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:31.738586 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fde75-b873-430a-907b-6a61b987fcb5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:31.748273 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 21/38] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:10:31.749383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf29ac-9ba4-40c0-b42d-502cab1632e4 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:31.749668 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf29ac-9ba4-40c0-b42d-502cab1632e4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:31.749941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf29ac-9ba4-40c0-b42d-502cab1632e4 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:31.751165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 22/39] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:31.760709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce387c09-99c6-42f1-82ef-e168247e5473 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:31.760709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce387c09-99c6-42f1-82ef-e168247e5473 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:31.760709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce387c09-99c6-42f1-82ef-e168247e5473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:31.780455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507588c-6eb9-4257-83f2-6523cced0a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:31.781051 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507588c-6eb9-4257-83f2-6523cced0a03 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:31.781329 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507588c-6eb9-4257-83f2-6523cced0a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:31.781605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507588c-6eb9-4257-83f2-6523cced0a03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:31.782714 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507588c-6eb9-4257-83f2-6523cced0a03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:31.784499 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507588c-6eb9-4257-83f2-6523cced0a03 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:31.785299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ce387c09-99c6-42f1-82ef-e168247e5473 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:31.786411 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 18/40] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:10:31 2022] GET /identity/v3/domains/default => generated 200 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:31.787356 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ce387c09-99c6-42f1-82ef-e168247e5473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:31.792486 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507588c-6eb9-4257-83f2-6523cced0a03 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:31.845171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:31.875162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 23/41] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:10:31.881238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce387c09-99c6-42f1-82ef-e168247e5473 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:31.911375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507588c-6eb9-4257-83f2-6523cced0a03 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:31.961128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0065bd8-03c0-4da0-8822-bfca61f3ff55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:31.962143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0065bd8-03c0-4da0-8822-bfca61f3ff55 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:31.962650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0065bd8-03c0-4da0-8822-bfca61f3ff55 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:31.963127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0065bd8-03c0-4da0-8822-bfca61f3ff55 None admin] PATH_INFO: `/v3/domains/default/users/7dbee4330ce74aedb00eece717c969c5/roles/97ece22f2e264e0e857d5107325a85d9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:31.966269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0065bd8-03c0-4da0-8822-bfca61f3ff55 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7dbee4330ce74aedb00eece717c969c5, role_id=97ece22f2e264e0e857d5107325a85d9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:31.968420 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0065bd8-03c0-4da0-8822-bfca61f3ff55 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:31.986634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 19/42] 10.222.0.107 () {58 vars in 1366 bytes} [Tue Aug 23 23:10:31 2022] PUT /identity/v3/domains/default/users/7dbee4330ce74aedb00eece717c969c5/roles/97ece22f2e264e0e857d5107325a85d9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:10:32.011099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce387c09-99c6-42f1-82ef-e168247e5473 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:32.020926 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0065bd8-03c0-4da0-8822-bfca61f3ff55 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:32.032725 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:32.067175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8640cbf-56e9-46a9-b2d1-b9aa03ba18c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:32.070131 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8640cbf-56e9-46a9-b2d1-b9aa03ba18c8 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:32.070702 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8640cbf-56e9-46a9-b2d1-b9aa03ba18c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:32.071296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8640cbf-56e9-46a9-b2d1-b9aa03ba18c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:32.072256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8640cbf-56e9-46a9-b2d1-b9aa03ba18c8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:32.073934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8640cbf-56e9-46a9-b2d1-b9aa03ba18c8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:32.095479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 24/43] 10.222.0.107 () {60 vars in 1136 bytes} [Tue Aug 23 23:10:31 2022] POST /identity/v3/roles => generated 226 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:10:32.158231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0065bd8-03c0-4da0-8822-bfca61f3ff55 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:32.162380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8640cbf-56e9-46a9-b2d1-b9aa03ba18c8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:32.203972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b2ddd-9b9d-4b7f-839f-767761bc19ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:32.204647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b2ddd-9b9d-4b7f-839f-767761bc19ea None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:32.204934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b2ddd-9b9d-4b7f-839f-767761bc19ea None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:32.205209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b2ddd-9b9d-4b7f-839f-767761bc19ea None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:32.205897 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b2ddd-9b9d-4b7f-839f-767761bc19ea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:32.207434 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b2ddd-9b9d-4b7f-839f-767761bc19ea None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:32.227209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 20/44] 10.222.0.107 () {60 vars in 1136 bytes} [Tue Aug 23 23:10:32 2022] POST /identity/v3/roles => generated 224 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:10:32.322535 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:32.405249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8640cbf-56e9-46a9-b2d1-b9aa03ba18c8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:32.445386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5c34f-12e2-4905-885c-b0d1cc2ae7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:32.446041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5c34f-12e2-4905-885c-b0d1cc2ae7ad None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:32.446322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5c34f-12e2-4905-885c-b0d1cc2ae7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:32.446598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5c34f-12e2-4905-885c-b0d1cc2ae7ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:32.447733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5c34f-12e2-4905-885c-b0d1cc2ae7ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:32.449246 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5c34f-12e2-4905-885c-b0d1cc2ae7ad None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:32.450830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 25/45] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:10:32 2022] GET /identity/v3/domains/default => generated 200 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:10:32.456416 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b2ddd-9b9d-4b7f-839f-767761bc19ea None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:32.525537 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:32.568431 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b2ddd-9b9d-4b7f-839f-767761bc19ea None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:32.603140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68329c9-f8f4-4014-97cd-521cdab0666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:32.603675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68329c9-f8f4-4014-97cd-521cdab0666d None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:32.603951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68329c9-f8f4-4014-97cd-521cdab0666d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:32.604225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68329c9-f8f4-4014-97cd-521cdab0666d None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:32.604923 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68329c9-f8f4-4014-97cd-521cdab0666d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:32.606391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68329c9-f8f4-4014-97cd-521cdab0666d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:32.640425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 21/46] 10.222.0.107 () {60 vars in 1146 bytes} [Tue Aug 23 23:10:32 2022] POST /identity/v3/projects => generated 313 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:10:33.963070 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6665097-87fb-4a7c-b584-1947ae375d4a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:33.963594 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6665097-87fb-4a7c-b584-1947ae375d4a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:33.963701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6665097-87fb-4a7c-b584-1947ae375d4a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:33.965256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 26/47] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:33.970588 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2851093-e807-4bdf-87ce-ae08bf645224 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:33.971011 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2851093-e807-4bdf-87ce-ae08bf645224 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:33.971235 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2851093-e807-4bdf-87ce-ae08bf645224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:33.990968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d2851093-e807-4bdf-87ce-ae08bf645224 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:33.992193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d2851093-e807-4bdf-87ce-ae08bf645224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:34.061462 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 22/48] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:34.329778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6665097-87fb-4a7c-b584-1947ae375d4a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:34.432312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6665097-87fb-4a7c-b584-1947ae375d4a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:34.434662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:34.468152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb4fd4-27fa-48fe-b276-ff8a5bd92401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:34.468815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb4fd4-27fa-48fe-b276-ff8a5bd92401 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:34.469099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb4fd4-27fa-48fe-b276-ff8a5bd92401 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:34.469375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb4fd4-27fa-48fe-b276-ff8a5bd92401 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:34.479404 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb4fd4-27fa-48fe-b276-ff8a5bd92401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:34.484136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-a7eb4fd4-27fa-48fe-b276-ff8a5bd92401 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:10:34.484136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:34.484136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:34.484136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:34.484136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:34.484136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:34.484136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:34.484136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:34.484136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:34.484136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:34.484136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:34.484136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:34.484136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:34.484136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:34.484136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:34.484136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:34.485048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:34.485048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:34.485048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:34.485048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:34.485048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:34.485048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:34.485048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:34.485048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:34.485048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:34.485048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:34.485048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:34.485048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:34.485048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:34.485048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:34.485048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:34.485048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:34.485879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:34.485879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:34.485879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:34.485879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:34.485879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:34.485879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:34.485879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:34.485879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:34.485879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:34.485879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:34.485879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:10:34.485879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:10:34.485879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 27/49] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:10:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:34.491630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2851093-e807-4bdf-87ce-ae08bf645224 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:34.540272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:34.561658 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe4a9c-7390-4ca1-a429-c9831aa261e5 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:34.561949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe4a9c-7390-4ca1-a429-c9831aa261e5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:34.562227 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe4a9c-7390-4ca1-a429-c9831aa261e5 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:34.563566 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 28/50] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:34.569470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669e5d5-d0d3-49f0-b406-dbcc495f3669 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:34.569943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669e5d5-d0d3-49f0-b406-dbcc495f3669 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:34.570427 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669e5d5-d0d3-49f0-b406-dbcc495f3669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:34.597687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2851093-e807-4bdf-87ce-ae08bf645224 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:34.599850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f669e5d5-d0d3-49f0-b406-dbcc495f3669 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:34.601094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f669e5d5-d0d3-49f0-b406-dbcc495f3669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:34.632134 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477664b5-1668-4bf8-8133-83b09f09bab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:34.632787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477664b5-1668-4bf8-8133-83b09f09bab2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:34.633081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477664b5-1668-4bf8-8133-83b09f09bab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:34.633350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477664b5-1668-4bf8-8133-83b09f09bab2 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:34.634023 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477664b5-1668-4bf8-8133-83b09f09bab2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:34.634324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477664b5-1668-4bf8-8133-83b09f09bab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:34.635712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477664b5-1668-4bf8-8133-83b09f09bab2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:34.648260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 23/51] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:10:34 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:34.653592 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477664b5-1668-4bf8-8133-83b09f09bab2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:34.670456 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 29/52] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:34.751315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477664b5-1668-4bf8-8133-83b09f09bab2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:34.762530 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:34.786436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f800f2d-1b50-49f0-afa2-9a943045888c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:34.787074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f800f2d-1b50-49f0-afa2-9a943045888c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:34.787355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f800f2d-1b50-49f0-afa2-9a943045888c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:34.787629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f800f2d-1b50-49f0-afa2-9a943045888c None admin] PATH_INFO: `/v3/users/7dbee4330ce74aedb00eece717c969c5` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:34.788797 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f800f2d-1b50-49f0-afa2-9a943045888c None admin] RBAC: Authorizing `identity:get_user(user_id=7dbee4330ce74aedb00eece717c969c5)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:34.790521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f800f2d-1b50-49f0-afa2-9a943045888c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:34.792122 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 24/53] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:34 2022] GET /identity/v3/users/7dbee4330ce74aedb00eece717c969c5 => generated 248 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:10:34.797913 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669e5d5-d0d3-49f0-b406-dbcc495f3669 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:34.890083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:34.898086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669e5d5-d0d3-49f0-b406-dbcc495f3669 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:34.931286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6ff2f-2b02-4554-884e-37ba03b8a1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:34.931913 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6ff2f-2b02-4554-884e-37ba03b8a1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:34.932224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6ff2f-2b02-4554-884e-37ba03b8a1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:34.932508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6ff2f-2b02-4554-884e-37ba03b8a1f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:34.933653 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6ff2f-2b02-4554-884e-37ba03b8a1f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:34.935106 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6ff2f-2b02-4554-884e-37ba03b8a1f8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:34.936726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 30/54] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:10:34 2022] GET /identity/v3/domains/default => generated 200 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:34.942629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f800f2d-1b50-49f0-afa2-9a943045888c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:34.942971 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6ff2f-2b02-4554-884e-37ba03b8a1f8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:35.048680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6ff2f-2b02-4554-884e-37ba03b8a1f8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:35.065021 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f800f2d-1b50-49f0-afa2-9a943045888c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:35.084137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f427a5a-128a-4cf0-b7c5-73bbe2c24ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:35.084802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f427a5a-128a-4cf0-b7c5-73bbe2c24ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:35.085087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f427a5a-128a-4cf0-b7c5-73bbe2c24ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:35.085366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f427a5a-128a-4cf0-b7c5-73bbe2c24ec7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:35.086120 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f427a5a-128a-4cf0-b7c5-73bbe2c24ec7 None admin] RBAC: Adding query filter params (role.id=97ece22f2e264e0e857d5107325a85d9, scope.domain.id=default, user.id=7dbee4330ce74aedb00eece717c969c5) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:35.086427 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f427a5a-128a-4cf0-b7c5-73bbe2c24ec7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:35.087935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f427a5a-128a-4cf0-b7c5-73bbe2c24ec7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:35.094996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 31/55] 10.222.0.107 () {56 vars in 1327 bytes} [Tue Aug 23 23:10:34 2022] GET /identity/v3/role_assignments?user.id=7dbee4330ce74aedb00eece717c969c5&scope.domain.id=default&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 532 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:10:35.211792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440d609-d30f-460a-b333-f1ef2266fa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:35.212468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440d609-d30f-460a-b333-f1ef2266fa81 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:35.212782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440d609-d30f-460a-b333-f1ef2266fa81 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:35.213059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440d609-d30f-460a-b333-f1ef2266fa81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:35.214298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440d609-d30f-460a-b333-f1ef2266fa81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:35.215807 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440d609-d30f-460a-b333-f1ef2266fa81 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:35.217526 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 25/56] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:10:34 2022] GET /identity/v3/domains/default => generated 200 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:35.223285 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f427a5a-128a-4cf0-b7c5-73bbe2c24ec7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:35.256331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:35.334529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f427a5a-128a-4cf0-b7c5-73bbe2c24ec7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:35.379014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4664b-2f89-4c7e-93f3-bc7fad9df383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:35.380331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4664b-2f89-4c7e-93f3-bc7fad9df383 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:35.380550 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4664b-2f89-4c7e-93f3-bc7fad9df383 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:35.380863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4664b-2f89-4c7e-93f3-bc7fad9df383 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:35.381555 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4664b-2f89-4c7e-93f3-bc7fad9df383 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:35.382997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4664b-2f89-4c7e-93f3-bc7fad9df383 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:35.425649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 32/57] 10.222.0.107 () {60 vars in 1145 bytes} [Tue Aug 23 23:10:35 2022] POST /identity/v3/projects => generated 299 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:10:37.471408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169f2c0-4c4d-4f04-bb24-834e2f8c89cd None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:37.471907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169f2c0-4c4d-4f04-bb24-834e2f8c89cd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:37.472020 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169f2c0-4c4d-4f04-bb24-834e2f8c89cd None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:37.473370 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 26/58] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:37.478618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d357e-a585-41ae-ab3b-bf552c7e2beb None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:37.478995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d357e-a585-41ae-ab3b-bf552c7e2beb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:37.479172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d357e-a585-41ae-ab3b-bf552c7e2beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:37.497264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ac5d357e-a585-41ae-ab3b-bf552c7e2beb None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:37.498470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ac5d357e-a585-41ae-ab3b-bf552c7e2beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:37.563050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 33/59] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:37.832031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169f2c0-4c4d-4f04-bb24-834e2f8c89cd None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:37.880522 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:37.935623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169f2c0-4c4d-4f04-bb24-834e2f8c89cd None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:37.967777 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a8ef8-55a9-45d7-9a88-45bdbbfb55e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:37.968404 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a8ef8-55a9-45d7-9a88-45bdbbfb55e2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:37.968712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a8ef8-55a9-45d7-9a88-45bdbbfb55e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:37.969338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a8ef8-55a9-45d7-9a88-45bdbbfb55e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:37.970469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a8ef8-55a9-45d7-9a88-45bdbbfb55e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:37.971945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a8ef8-55a9-45d7-9a88-45bdbbfb55e2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:37.974192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 27/60] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:10:37 2022] GET /identity/v3/domains/default => generated 200 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:37.980663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d357e-a585-41ae-ab3b-bf552c7e2beb None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:37.991613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:38.082563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d357e-a585-41ae-ab3b-bf552c7e2beb None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:38.116574 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08a9d3-3e43-4b23-ab04-e9f664c59d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:38.117204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08a9d3-3e43-4b23-ab04-e9f664c59d02 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:38.117484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08a9d3-3e43-4b23-ab04-e9f664c59d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:38.117757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08a9d3-3e43-4b23-ab04-e9f664c59d02 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:38.118410 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08a9d3-3e43-4b23-ab04-e9f664c59d02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:38.119847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08a9d3-3e43-4b23-ab04-e9f664c59d02 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:38.147035 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 34/61] 10.222.0.107 () {60 vars in 1137 bytes} [Tue Aug 23 23:10:37 2022] POST /identity/v3/users => generated 276 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:10:41.051285 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc4351-e6d1-44c4-aa20-5d2715e4f16d None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:41.052243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc4351-e6d1-44c4-aa20-5d2715e4f16d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:41.052755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc4351-e6d1-44c4-aa20-5d2715e4f16d None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:41.055149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 28/62] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:41 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:41.060316 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122ef23-6462-41ed-a386-1fd94d66373c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:41.060827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122ef23-6462-41ed-a386-1fd94d66373c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:41.060901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122ef23-6462-41ed-a386-1fd94d66373c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:41.082131 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b122ef23-6462-41ed-a386-1fd94d66373c None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:41.083681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b122ef23-6462-41ed-a386-1fd94d66373c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:41.169939 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:41.185136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 35/63] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:41.347225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508eead-4aa2-4fc0-b1cf-8772b688c97b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:41.347569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508eead-4aa2-4fc0-b1cf-8772b688c97b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:41.347747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508eead-4aa2-4fc0-b1cf-8772b688c97b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:41.349245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 29/64] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:41.355483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d5b3f-0279-4484-8e63-0ceb3b22b8f4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:41.356025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d5b3f-0279-4484-8e63-0ceb3b22b8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:41.356495 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d5b3f-0279-4484-8e63-0ceb3b22b8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:41.389695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4d5d5b3f-0279-4484-8e63-0ceb3b22b8f4 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:41.390945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4d5d5b3f-0279-4484-8e63-0ceb3b22b8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:41.483300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 36/65] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:10:41.529598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508eead-4aa2-4fc0-b1cf-8772b688c97b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:41.646607 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eed325-e2a5-42f1-974d-152612ce6b27 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:41.647350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eed325-e2a5-42f1-974d-152612ce6b27 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:41.647742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eed325-e2a5-42f1-974d-152612ce6b27 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:41.649411 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 37/66] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:10:41.654639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb5d9f-941e-4249-98c7-b1f2c914ece2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:41.654929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb5d9f-941e-4249-98c7-b1f2c914ece2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:41.655210 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb5d9f-941e-4249-98c7-b1f2c914ece2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:41.675224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508eead-4aa2-4fc0-b1cf-8772b688c97b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:41.687934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7dcb5d9f-941e-4249-98c7-b1f2c914ece2 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:41.689175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7dcb5d9f-941e-4249-98c7-b1f2c914ece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:41.717006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:41.727757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc896c4-c859-4d08-b5e6-faef6ee03049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:41.728416 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc896c4-c859-4d08-b5e6-faef6ee03049 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:41.728731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc896c4-c859-4d08-b5e6-faef6ee03049 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:41.729009 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc896c4-c859-4d08-b5e6-faef6ee03049 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:41.742679 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc896c4-c859-4d08-b5e6-faef6ee03049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:41.747497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-6fc896c4-c859-4d08-b5e6-faef6ee03049 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:10:41.747497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:41.747497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:41.747497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:41.747497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:41.747497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:41.747497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:41.747497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:41.747497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:41.747497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:41.747497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:41.747497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:41.747497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:41.747497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:41.747497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:41.747497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:41.748436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:41.748436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:41.748436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:41.748436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:41.748436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:41.748436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:41.748436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:41.748436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:41.748436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:41.748436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:41.748436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:41.748436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:41.748436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:41.748436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:41.748436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:41.748436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:41.749228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:41.749228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:41.749228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:41.749228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:41.749228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:41.749228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:41.749228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:41.749228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:41.749228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:41.749228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:41.749228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:10:41.749228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:10:41.749228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 30/67] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:10:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:41.754746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc896c4-c859-4d08-b5e6-faef6ee03049 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:41.835490 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 38/68] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:10:41.836372 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb5d9f-941e-4249-98c7-b1f2c914ece2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:41.879925 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc896c4-c859-4d08-b5e6-faef6ee03049 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:41.914726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:41.916989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834f10d-a3e1-4321-a67d-5926c8732770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:41.917914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834f10d-a3e1-4321-a67d-5926c8732770 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:41.918200 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834f10d-a3e1-4321-a67d-5926c8732770 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:41.918500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834f10d-a3e1-4321-a67d-5926c8732770 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:41.919190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834f10d-a3e1-4321-a67d-5926c8732770 None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:41.919496 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834f10d-a3e1-4321-a67d-5926c8732770 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:41.921468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834f10d-a3e1-4321-a67d-5926c8732770 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:41.931879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 31/69] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:10:41 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:10:41.933339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f756fc5-436a-4d71-972a-da5b0d7da1fb None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:41.933623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f756fc5-436a-4d71-972a-da5b0d7da1fb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:41.933897 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f756fc5-436a-4d71-972a-da5b0d7da1fb None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:41.939290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 32/70] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:41.940238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f756fc5-436a-4d71-972a-da5b0d7da1fb None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:41.972658 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb5d9f-941e-4249-98c7-b1f2c914ece2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:41.981751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:42.033916 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ec5f5-49e5-48e1-bf94-5404a9663caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:42.034817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ec5f5-49e5-48e1-bf94-5404a9663caa None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:42.035163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ec5f5-49e5-48e1-bf94-5404a9663caa None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:42.035444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ec5f5-49e5-48e1-bf94-5404a9663caa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:42.051018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ec5f5-49e5-48e1-bf94-5404a9663caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:42.057144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f756fc5-436a-4d71-972a-da5b0d7da1fb None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:42.058097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2c0ec5f5-49e5-48e1-bf94-5404a9663caa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:10:42.058097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:42.058097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:42.058097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:42.058097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:42.058097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:42.058097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:42.058097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:42.058097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:42.058097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:42.058097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:42.058097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:42.058097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:42.058097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:42.058097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:42.058097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:42.058940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:42.058940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:42.058940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:42.058940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:42.058940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:42.058940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:42.058940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:42.058940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:42.058940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:42.058940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:42.058940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:42.058940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:42.058940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:42.058940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:42.058940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:42.058940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:42.059710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:42.059710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:42.059710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:42.059710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:42.059710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:42.059710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:42.059710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:42.059710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:42.059710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:42.059710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:42.059710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:10:42.059710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:10:42.059710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 39/71] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:10:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:42.061328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0981e5-7905-4994-8542-2e51d3e69910 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:42.061839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0981e5-7905-4994-8542-2e51d3e69910 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:42.061839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0981e5-7905-4994-8542-2e51d3e69910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:42.087390 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bc0981e5-7905-4994-8542-2e51d3e69910 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:42.088633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bc0981e5-7905-4994-8542-2e51d3e69910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:42.106005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983907d-db0b-483a-b802-11e95a60d765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:42.107135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983907d-db0b-483a-b802-11e95a60d765 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:42.107906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983907d-db0b-483a-b802-11e95a60d765 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:42.108432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983907d-db0b-483a-b802-11e95a60d765 None admin] PATH_INFO: `/v3/users/42c3d6abafce4a929b4b6685de4943e5` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:42.126887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983907d-db0b-483a-b802-11e95a60d765 None admin] RBAC: Authorizing `identity:get_user(user_id=42c3d6abafce4a929b4b6685de4943e5)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:42.128664 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983907d-db0b-483a-b802-11e95a60d765 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:42.130651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 33/72] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:41 2022] GET /identity/v3/users/42c3d6abafce4a929b4b6685de4943e5 => generated 276 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:42.132409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983907d-db0b-483a-b802-11e95a60d765 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:42.163934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 40/73] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:42.165932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed25c1c-7b75-4ec7-815a-b50ba551ef96 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:42.166216 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed25c1c-7b75-4ec7-815a-b50ba551ef96 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:42.166561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed25c1c-7b75-4ec7-815a-b50ba551ef96 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:42.168076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 41/74] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:42.173060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed25c1c-7b75-4ec7-815a-b50ba551ef96 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:42.226017 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:42.244531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:42.252819 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983907d-db0b-483a-b802-11e95a60d765 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:42.291543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed25c1c-7b75-4ec7-815a-b50ba551ef96 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:42.295331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9ca1e-96fe-4f0d-aca1-e4858609d23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:42.295952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9ca1e-96fe-4f0d-aca1-e4858609d23d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:42.296240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9ca1e-96fe-4f0d-aca1-e4858609d23d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:42.296517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9ca1e-96fe-4f0d-aca1-e4858609d23d None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:42.297221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9ca1e-96fe-4f0d-aca1-e4858609d23d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:42.297527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9ca1e-96fe-4f0d-aca1-e4858609d23d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:42.298912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9ca1e-96fe-4f0d-aca1-e4858609d23d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:42.308084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 34/75] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:10:42 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:42.309361 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edda67c-909b-40f5-9f2d-3b4cc1fb11ec None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:42.309646 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edda67c-909b-40f5-9f2d-3b4cc1fb11ec None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:42.309924 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edda67c-909b-40f5-9f2d-3b4cc1fb11ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:42.329289 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6edda67c-909b-40f5-9f2d-3b4cc1fb11ec None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:42.330519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6edda67c-909b-40f5-9f2d-3b4cc1fb11ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:42.340973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38afe3-a720-412d-ae9c-920bc3fcef4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:42.342158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38afe3-a720-412d-ae9c-920bc3fcef4c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:42.342611 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38afe3-a720-412d-ae9c-920bc3fcef4c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:42.343079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38afe3-a720-412d-ae9c-920bc3fcef4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:42.404522 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 35/76] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:42.405654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edda67c-909b-40f5-9f2d-3b4cc1fb11ec None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:42.428225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38afe3-a720-412d-ae9c-920bc3fcef4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:42.429795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38afe3-a720-412d-ae9c-920bc3fcef4c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:42.484707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:42.499322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:42.515906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edda67c-909b-40f5-9f2d-3b4cc1fb11ec None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:42.548337 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 42/77] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:10:42 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:10:42.549021 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38afe3-a720-412d-ae9c-920bc3fcef4c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:42.557080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2f21a-28c6-4119-8563-c074e181e45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:42.557720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2f21a-28c6-4119-8563-c074e181e45a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:42.558004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2f21a-28c6-4119-8563-c074e181e45a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:42.558281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2f21a-28c6-4119-8563-c074e181e45a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:42.568497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2f21a-28c6-4119-8563-c074e181e45a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:42.573771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-84e2f21a-28c6-4119-8563-c074e181e45a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:10:42.573771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:42.573771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:42.573771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:42.573771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:42.573771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:42.573771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:42.573771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:42.573771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:42.573771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:42.573771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:42.573771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:42.573771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:42.573771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:42.573771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:42.573771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:42.574608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:42.574608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:42.574608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:42.574608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:42.574608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:42.574608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:42.574608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:42.574608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:42.574608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:42.574608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:42.574608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:42.574608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:42.574608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:42.574608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:42.574608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:42.574608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:42.575369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:42.575369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:42.575369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:42.575369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:42.575369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:42.575369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:42.575369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:42.575369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:42.575369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:42.575369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:42.575369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:10:42.575369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:10:42.575369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 36/78] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:10:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:42.575994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2f21a-28c6-4119-8563-c074e181e45a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:42.664664 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38afe3-a720-412d-ae9c-920bc3fcef4c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:42.699624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2f21a-28c6-4119-8563-c074e181e45a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:42.711015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342eb9b-1d26-473f-9de4-a24679f9c008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:42.711663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342eb9b-1d26-473f-9de4-a24679f9c008 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:42.711942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342eb9b-1d26-473f-9de4-a24679f9c008 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:42.712217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342eb9b-1d26-473f-9de4-a24679f9c008 None admin] PATH_INFO: `/v3/users/7dbee4330ce74aedb00eece717c969c5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:42.713403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342eb9b-1d26-473f-9de4-a24679f9c008 None admin] RBAC: Authorizing `identity:get_user(user_id=7dbee4330ce74aedb00eece717c969c5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:42.714957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342eb9b-1d26-473f-9de4-a24679f9c008 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:42.716832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 43/79] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:42 2022] GET /identity/v3/users/7dbee4330ce74aedb00eece717c969c5 => generated 248 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:42.717406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342eb9b-1d26-473f-9de4-a24679f9c008 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:42.733721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:42.745717 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e65da-e0a6-4be2-b8f0-9d15007ac62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:42.746357 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e65da-e0a6-4be2-b8f0-9d15007ac62f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:42.746639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e65da-e0a6-4be2-b8f0-9d15007ac62f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:42.746912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e65da-e0a6-4be2-b8f0-9d15007ac62f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:42.758761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e65da-e0a6-4be2-b8f0-9d15007ac62f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:42.763483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-6c8e65da-e0a6-4be2-b8f0-9d15007ac62f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:10:42.763483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:42.763483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:42.763483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:42.763483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:42.763483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:42.763483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:42.763483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:42.763483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:42.763483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:42.763483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:42.763483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:42.763483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:42.763483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:42.763483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:42.763483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:42.764292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:42.764292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:42.764292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:42.764292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:42.764292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:42.764292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:42.764292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:42.764292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:42.764292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:42.764292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:42.764292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:42.764292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:42.764292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:42.764292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:42.764292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:42.764292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:42.765112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:42.765112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:42.765112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:42.765112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:42.765112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:42.765112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:42.765112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:42.765112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:42.765112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:42.765112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:42.765112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:10:42.765112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:10:42.765112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 37/80] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:10:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:42.766242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e65da-e0a6-4be2-b8f0-9d15007ac62f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:42.775468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:42.828848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342eb9b-1d26-473f-9de4-a24679f9c008 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:42.865071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b17a3-7f12-4f1c-b1ce-c47481a97490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:42.865861 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b17a3-7f12-4f1c-b1ce-c47481a97490 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:42.866355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b17a3-7f12-4f1c-b1ce-c47481a97490 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:42.866645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b17a3-7f12-4f1c-b1ce-c47481a97490 None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:42.867786 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b17a3-7f12-4f1c-b1ce-c47481a97490 None admin] RBAC: Authorizing `identity:get_project(project_id=7cf2243c0cdc44da93063ff4af6a2330)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:42.869260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b17a3-7f12-4f1c-b1ce-c47481a97490 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:42.870874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 44/81] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:10:42 2022] GET /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330 => generated 299 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:42.871629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b17a3-7f12-4f1c-b1ce-c47481a97490 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:42.879469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e65da-e0a6-4be2-b8f0-9d15007ac62f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:42.916506 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b22108-2eed-47bc-94c7-839ff737323b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:42.917709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b22108-2eed-47bc-94c7-839ff737323b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:42.917709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b22108-2eed-47bc-94c7-839ff737323b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:42.917709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b22108-2eed-47bc-94c7-839ff737323b None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:42.918367 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b22108-2eed-47bc-94c7-839ff737323b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:42.918671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b22108-2eed-47bc-94c7-839ff737323b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:42.920091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b22108-2eed-47bc-94c7-839ff737323b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:42.929777 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 38/82] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:10:42 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:42.930596 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b22108-2eed-47bc-94c7-839ff737323b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:42.955521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:42.976379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b17a3-7f12-4f1c-b1ce-c47481a97490 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:43.001826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:43.012013 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48a6d4-5534-4a0e-902b-287053b45f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:43.012670 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48a6d4-5534-4a0e-902b-287053b45f9d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:43.012955 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48a6d4-5534-4a0e-902b-287053b45f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:43.013233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48a6d4-5534-4a0e-902b-287053b45f9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:43.014363 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48a6d4-5534-4a0e-902b-287053b45f9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:43.015812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48a6d4-5534-4a0e-902b-287053b45f9d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:43.017428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 45/83] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:10:42 2022] GET /identity/v3/domains/default => generated 200 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:43.018203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48a6d4-5534-4a0e-902b-287053b45f9d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:43.044044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b22108-2eed-47bc-94c7-839ff737323b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:43.086560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130965e1-efd8-415e-8e94-7283d1197571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:43.087535 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130965e1-efd8-415e-8e94-7283d1197571 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:43.087535 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130965e1-efd8-415e-8e94-7283d1197571 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:43.087824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130965e1-efd8-415e-8e94-7283d1197571 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:43.133188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48a6d4-5534-4a0e-902b-287053b45f9d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:43.158351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130965e1-efd8-415e-8e94-7283d1197571 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:43.159840 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130965e1-efd8-415e-8e94-7283d1197571 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:43.167603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f22fb-804e-463e-9fe2-e985243eca9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:43.168212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f22fb-804e-463e-9fe2-e985243eca9b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:43.168490 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f22fb-804e-463e-9fe2-e985243eca9b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:43.168796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f22fb-804e-463e-9fe2-e985243eca9b None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:43.169467 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f22fb-804e-463e-9fe2-e985243eca9b None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:43.169777 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f22fb-804e-463e-9fe2-e985243eca9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:43.171146 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f22fb-804e-463e-9fe2-e985243eca9b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:43.179597 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 46/84] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:10:43 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:43.180400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f22fb-804e-463e-9fe2-e985243eca9b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:43.192571 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:43.237619 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:43.274141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 39/85] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:10:42 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:10:43.275337 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130965e1-efd8-415e-8e94-7283d1197571 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:43.284339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f22fb-804e-463e-9fe2-e985243eca9b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:43.319748 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2b1c2-fff4-485d-a82e-37bf67cec112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:43.320355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2b1c2-fff4-485d-a82e-37bf67cec112 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:43.320666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2b1c2-fff4-485d-a82e-37bf67cec112 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:43.320945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2b1c2-fff4-485d-a82e-37bf67cec112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:43.321673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2b1c2-fff4-485d-a82e-37bf67cec112 None admin] RBAC: Adding query filter params (role.id=6be1975947cd4b948b86c73132244927, scope.project.id=7cf2243c0cdc44da93063ff4af6a2330, user.id=42c3d6abafce4a929b4b6685de4943e5) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:43.321982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2b1c2-fff4-485d-a82e-37bf67cec112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:43.323441 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2b1c2-fff4-485d-a82e-37bf67cec112 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:43.328892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 47/86] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:10:43 2022] GET /identity/v3/role_assignments?user.id=42c3d6abafce4a929b4b6685de4943e5&scope.project.id=7cf2243c0cdc44da93063ff4af6a2330&role.id=6be1975947cd4b948b86c73132244927 => generated 260 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:43.329665 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2b1c2-fff4-485d-a82e-37bf67cec112 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:43.385843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130965e1-efd8-415e-8e94-7283d1197571 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:43.426729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:43.429420 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3dd04-ea69-4f9a-ad0a-5a51923fcd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:43.430162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3dd04-ea69-4f9a-ad0a-5a51923fcd4c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:43.430364 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3dd04-ea69-4f9a-ad0a-5a51923fcd4c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:43.430800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3dd04-ea69-4f9a-ad0a-5a51923fcd4c None admin] PATH_INFO: `/v3/users/42c3d6abafce4a929b4b6685de4943e5` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:43.431825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3dd04-ea69-4f9a-ad0a-5a51923fcd4c None admin] RBAC: Authorizing `identity:get_user(user_id=42c3d6abafce4a929b4b6685de4943e5)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:43.433406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3dd04-ea69-4f9a-ad0a-5a51923fcd4c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:43.435075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 40/87] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:43 2022] GET /identity/v3/users/42c3d6abafce4a929b4b6685de4943e5 => generated 276 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:43.435881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3dd04-ea69-4f9a-ad0a-5a51923fcd4c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:43.461064 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2b1c2-fff4-485d-a82e-37bf67cec112 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:43.477672 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:43.508844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc3306-b0c7-4550-b83b-da96a95ab272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:43.509380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc3306-b0c7-4550-b83b-da96a95ab272 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:43.509660 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc3306-b0c7-4550-b83b-da96a95ab272 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:43.509934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc3306-b0c7-4550-b83b-da96a95ab272 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:43.510587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc3306-b0c7-4550-b83b-da96a95ab272 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:43.512057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc3306-b0c7-4550-b83b-da96a95ab272 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:43.533382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 48/88] 10.222.0.107 () {60 vars in 1137 bytes} [Tue Aug 23 23:10:43 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:10:43.534218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc3306-b0c7-4550-b83b-da96a95ab272 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:43.557796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3dd04-ea69-4f9a-ad0a-5a51923fcd4c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:43.609950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2eb55-bde3-4885-a1f4-1e81ef2f5c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:43.610983 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2eb55-bde3-4885-a1f4-1e81ef2f5c29 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:43.611491 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2eb55-bde3-4885-a1f4-1e81ef2f5c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:43.611940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2eb55-bde3-4885-a1f4-1e81ef2f5c29 None admin] PATH_INFO: `/v3/users/42c3d6abafce4a929b4b6685de4943e5` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:43.613601 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2eb55-bde3-4885-a1f4-1e81ef2f5c29 None admin] RBAC: Authorizing `identity:get_user(user_id=42c3d6abafce4a929b4b6685de4943e5)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:43.615103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2eb55-bde3-4885-a1f4-1e81ef2f5c29 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:43.617443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 41/89] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:43 2022] GET /identity/v3/users/42c3d6abafce4a929b4b6685de4943e5 => generated 276 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:43.618177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2eb55-bde3-4885-a1f4-1e81ef2f5c29 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:43.688929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc3306-b0c7-4550-b83b-da96a95ab272 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:43.734607 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:43.743626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2febb7d-6819-42c4-97dc-88ab65fd5ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:43.744291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2febb7d-6819-42c4-97dc-88ab65fd5ccd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:43.744933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2febb7d-6819-42c4-97dc-88ab65fd5ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:43.745279 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2febb7d-6819-42c4-97dc-88ab65fd5ccd None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:43.748421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2febb7d-6819-42c4-97dc-88ab65fd5ccd None admin] RBAC: Authorizing `identity:get_project(project_id=7cf2243c0cdc44da93063ff4af6a2330)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:43.750039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2febb7d-6819-42c4-97dc-88ab65fd5ccd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:43.751953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 49/90] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:10:43 2022] GET /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330 => generated 299 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:43.753412 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2febb7d-6819-42c4-97dc-88ab65fd5ccd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:43.761609 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2eb55-bde3-4885-a1f4-1e81ef2f5c29 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:43.765795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:43.829563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e578f-143b-49d1-b3f5-cc243cbb29c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:43.830345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e578f-143b-49d1-b3f5-cc243cbb29c8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:43.830633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e578f-143b-49d1-b3f5-cc243cbb29c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:43.830912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e578f-143b-49d1-b3f5-cc243cbb29c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:43.906872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2febb7d-6819-42c4-97dc-88ab65fd5ccd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:43.941395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e578f-143b-49d1-b3f5-cc243cbb29c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:43.942917 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e578f-143b-49d1-b3f5-cc243cbb29c8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:43.960700 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756e7d9-1200-4745-95fe-172ec34e52ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:43.961213 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756e7d9-1200-4745-95fe-172ec34e52ef None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:43.961499 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756e7d9-1200-4745-95fe-172ec34e52ef None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:43.961782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756e7d9-1200-4745-95fe-172ec34e52ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:44.059134 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756e7d9-1200-4745-95fe-172ec34e52ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:44.059793 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:44.065391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756e7d9-1200-4745-95fe-172ec34e52ef None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:44.080823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 42/91] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:10:43 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:10:44.081637 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e578f-143b-49d1-b3f5-cc243cbb29c8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:44.085836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:44.206413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 50/92] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:10:43 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:10:44.207062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756e7d9-1200-4745-95fe-172ec34e52ef None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:44.236046 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e578f-143b-49d1-b3f5-cc243cbb29c8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:44.277792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5aa0f-c9a9-4fad-a8fe-68450374a03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:44.278527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5aa0f-c9a9-4fad-a8fe-68450374a03f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:44.278818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5aa0f-c9a9-4fad-a8fe-68450374a03f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:44.279103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5aa0f-c9a9-4fad-a8fe-68450374a03f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:44.279849 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5aa0f-c9a9-4fad-a8fe-68450374a03f None admin] RBAC: Adding query filter params (role.id=97ece22f2e264e0e857d5107325a85d9, scope.project.id=7cf2243c0cdc44da93063ff4af6a2330, user.id=7dbee4330ce74aedb00eece717c969c5) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:44.280165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5aa0f-c9a9-4fad-a8fe-68450374a03f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:44.281774 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5aa0f-c9a9-4fad-a8fe-68450374a03f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:44.290595 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 43/93] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:10:44 2022] GET /identity/v3/role_assignments?user.id=7dbee4330ce74aedb00eece717c969c5&scope.project.id=7cf2243c0cdc44da93063ff4af6a2330&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:44.291240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5aa0f-c9a9-4fad-a8fe-68450374a03f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:44.369662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:44.411360 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5aa0f-c9a9-4fad-a8fe-68450374a03f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:44.418850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:44.430420 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756e7d9-1200-4745-95fe-172ec34e52ef None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:44.451364 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d0fe3-8713-40a5-984d-b692f28f26ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:44.452012 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d0fe3-8713-40a5-984d-b692f28f26ef None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:44.452356 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d0fe3-8713-40a5-984d-b692f28f26ef None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:44.452663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d0fe3-8713-40a5-984d-b692f28f26ef None admin] PATH_INFO: `/v3/projects/b88f11b3ef5444f9b22ed43d4a86d7d3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:44.453879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d0fe3-8713-40a5-984d-b692f28f26ef None admin] RBAC: Authorizing `identity:get_project(project_id=b88f11b3ef5444f9b22ed43d4a86d7d3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:44.455367 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d0fe3-8713-40a5-984d-b692f28f26ef None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:44.457484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 44/94] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:10:44 2022] GET /identity/v3/projects/b88f11b3ef5444f9b22ed43d4a86d7d3 => generated 313 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:44.463540 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d0fe3-8713-40a5-984d-b692f28f26ef None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:44.493649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6446ed-4611-423f-9c18-b40367f4d8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:44.494299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6446ed-4611-423f-9c18-b40367f4d8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:44.494684 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6446ed-4611-423f-9c18-b40367f4d8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:44.494964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6446ed-4611-423f-9c18-b40367f4d8b4 None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:44.497158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6446ed-4611-423f-9c18-b40367f4d8b4 None admin] RBAC: Authorizing `identity:get_project(project_id=7cf2243c0cdc44da93063ff4af6a2330)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:44.498866 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6446ed-4611-423f-9c18-b40367f4d8b4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:44.500882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 51/95] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:10:44 2022] GET /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330 => generated 299 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:44.507454 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6446ed-4611-423f-9c18-b40367f4d8b4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:44.578392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d0fe3-8713-40a5-984d-b692f28f26ef None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:44.614978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddedf1-c9c3-4aae-80eb-16a015553a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:44.615803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddedf1-c9c3-4aae-80eb-16a015553a78 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:44.616161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddedf1-c9c3-4aae-80eb-16a015553a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:44.616400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddedf1-c9c3-4aae-80eb-16a015553a78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:44.617239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddedf1-c9c3-4aae-80eb-16a015553a78 None admin] RBAC: Adding query filter params (role.id=6be1975947cd4b948b86c73132244927, scope.project.id=b88f11b3ef5444f9b22ed43d4a86d7d3, user.id=42c3d6abafce4a929b4b6685de4943e5) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:44.617552 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddedf1-c9c3-4aae-80eb-16a015553a78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:44.619010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddedf1-c9c3-4aae-80eb-16a015553a78 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:44.623565 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:44.625599 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 45/96] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:10:44 2022] GET /identity/v3/role_assignments?user.id=42c3d6abafce4a929b4b6685de4943e5&scope.project.id=b88f11b3ef5444f9b22ed43d4a86d7d3&role.id=6be1975947cd4b948b86c73132244927 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:10:44.712228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6446ed-4611-423f-9c18-b40367f4d8b4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:44.763580 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e54b6-caf0-4044-8bac-1d6bbcb6e567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:44.764572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e54b6-caf0-4044-8bac-1d6bbcb6e567 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:44.765105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e54b6-caf0-4044-8bac-1d6bbcb6e567 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:44.765579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e54b6-caf0-4044-8bac-1d6bbcb6e567 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:44.766519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e54b6-caf0-4044-8bac-1d6bbcb6e567 None admin] RBAC: Adding query filter params (role.id=8801d305c8374d34abe896d3b7685174, scope.project.id=7cf2243c0cdc44da93063ff4af6a2330, user.id=42c3d6abafce4a929b4b6685de4943e5) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:44.767036 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e54b6-caf0-4044-8bac-1d6bbcb6e567 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:44.768777 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e54b6-caf0-4044-8bac-1d6bbcb6e567 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:44.780003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 52/97] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:10:44 2022] GET /identity/v3/role_assignments?user.id=42c3d6abafce4a929b4b6685de4943e5&scope.project.id=7cf2243c0cdc44da93063ff4af6a2330&role.id=8801d305c8374d34abe896d3b7685174 => generated 260 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:10:45.559258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397400f5-e2dd-4816-aa86-9f0764a762d7 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:45.559777 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397400f5-e2dd-4816-aa86-9f0764a762d7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:45.559849 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397400f5-e2dd-4816-aa86-9f0764a762d7 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:45.561224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 46/98] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:45.581718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff69f07-18b5-4ca2-9cc2-ed6ece2fd75b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:45.582701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff69f07-18b5-4ca2-9cc2-ed6ece2fd75b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:45.583185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff69f07-18b5-4ca2-9cc2-ed6ece2fd75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:45.609620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9ff69f07-18b5-4ca2-9cc2-ed6ece2fd75b None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:45.611184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9ff69f07-18b5-4ca2-9cc2-ed6ece2fd75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:45.637757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:45.693072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 53/99] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:46.231319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397400f5-e2dd-4816-aa86-9f0764a762d7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:46.373372 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397400f5-e2dd-4816-aa86-9f0764a762d7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:46.420980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047984b-4803-43f8-8b0e-cc0a6db1d3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:46.421970 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047984b-4803-43f8-8b0e-cc0a6db1d3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:46.422448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047984b-4803-43f8-8b0e-cc0a6db1d3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:46.422940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047984b-4803-43f8-8b0e-cc0a6db1d3e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:46.445534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047984b-4803-43f8-8b0e-cc0a6db1d3e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:46.451667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-5047984b-4803-43f8-8b0e-cc0a6db1d3e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:10:46.451667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:46.451667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:46.451667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:46.451667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:46.451667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:46.451667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:46.451667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:46.451667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:46.451667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:46.451667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:46.451667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:46.451667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:46.451667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:46.451667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:46.451667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:46.452503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:46.452503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:46.452503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:46.452503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:46.452503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:46.452503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:46.452503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:46.452503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:46.452503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:46.452503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:46.452503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:46.452503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:46.452503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:46.452503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:46.452503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:46.452503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:46.453303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:46.453303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:46.453303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:46.453303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:46.453303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:46.453303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:46.453303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:46.453303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:46.453303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:46.453303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:46.453303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:10:46.453303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:10:46.455479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 47/100] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:10:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:10:46.465730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff69f07-18b5-4ca2-9cc2-ed6ece2fd75b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:46.635864 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caf014-e85a-4c07-8793-b16e465896d1 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:46.636958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caf014-e85a-4c07-8793-b16e465896d1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:46.637439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caf014-e85a-4c07-8793-b16e465896d1 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:46.638968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 48/101] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:10:46.645990 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1f7d3-1964-4e97-a664-f036126375b6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:46.646596 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1f7d3-1964-4e97-a664-f036126375b6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:46.647595 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1f7d3-1964-4e97-a664-f036126375b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:46.654914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff69f07-18b5-4ca2-9cc2-ed6ece2fd75b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:46.681937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-16a1f7d3-1964-4e97-a664-f036126375b6 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:46.683465 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-16a1f7d3-1964-4e97-a664-f036126375b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:46.717260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ad8cb-31ee-40dc-8ae0-aab81a6a8fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:46.718187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ad8cb-31ee-40dc-8ae0-aab81a6a8fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:46.718619 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ad8cb-31ee-40dc-8ae0-aab81a6a8fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:46.719053 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ad8cb-31ee-40dc-8ae0-aab81a6a8fa7 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:46.720188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ad8cb-31ee-40dc-8ae0-aab81a6a8fa7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:46.720686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ad8cb-31ee-40dc-8ae0-aab81a6a8fa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:46.722872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ad8cb-31ee-40dc-8ae0-aab81a6a8fa7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:46.744733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 54/102] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:10:46 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:46.750219 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ad8cb-31ee-40dc-8ae0-aab81a6a8fa7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:46.808962 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:46.846491 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:46.878504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 49/103] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:46.879780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2716b55-8f7c-4344-ab9a-8b5a3269cd9b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:46.880064 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2716b55-8f7c-4344-ab9a-8b5a3269cd9b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:46.880337 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2716b55-8f7c-4344-ab9a-8b5a3269cd9b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:46.882166 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 50/104] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:46.889605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460865d2-5b00-403c-9f6b-0a6cbcb0a0d6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:46.889841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460865d2-5b00-403c-9f6b-0a6cbcb0a0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:46.890091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460865d2-5b00-403c-9f6b-0a6cbcb0a0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:46.929812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ad8cb-31ee-40dc-8ae0-aab81a6a8fa7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:46.932299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-460865d2-5b00-403c-9f6b-0a6cbcb0a0d6 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:46.933765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-460865d2-5b00-403c-9f6b-0a6cbcb0a0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:46.991610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344b145-cb48-4b52-8878-59f25781932a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:46.993223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344b145-cb48-4b52-8878-59f25781932a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:46.994851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344b145-cb48-4b52-8878-59f25781932a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:46.995345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344b145-cb48-4b52-8878-59f25781932a None admin] PATH_INFO: `/v3/users/42c3d6abafce4a929b4b6685de4943e5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:47.005209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344b145-cb48-4b52-8878-59f25781932a None admin] RBAC: Authorizing `identity:get_user(user_id=42c3d6abafce4a929b4b6685de4943e5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:47.005209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344b145-cb48-4b52-8878-59f25781932a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:47.005466 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 55/105] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:46 2022] GET /identity/v3/users/42c3d6abafce4a929b4b6685de4943e5 => generated 276 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:10:47.011319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344b145-cb48-4b52-8878-59f25781932a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:47.064854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 51/106] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:10:47.150272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:47.162053 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344b145-cb48-4b52-8878-59f25781932a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:47.207829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80543148-156f-4a32-badc-184b86d23107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:47.208467 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80543148-156f-4a32-badc-184b86d23107 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:47.208774 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80543148-156f-4a32-badc-184b86d23107 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:47.209079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80543148-156f-4a32-badc-184b86d23107 None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:47.212143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80543148-156f-4a32-badc-184b86d23107 None admin] RBAC: Authorizing `identity:get_project(project_id=7cf2243c0cdc44da93063ff4af6a2330)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:47.213794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80543148-156f-4a32-badc-184b86d23107 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:47.215722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 56/107] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:10:47 2022] GET /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330 => generated 299 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:47.221270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460865d2-5b00-403c-9f6b-0a6cbcb0a0d6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:47.337845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460865d2-5b00-403c-9f6b-0a6cbcb0a0d6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:47.360192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:47.375998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df970952-69a0-48aa-8236-7b6985f2980f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:47.376754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df970952-69a0-48aa-8236-7b6985f2980f None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:47.377040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df970952-69a0-48aa-8236-7b6985f2980f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:47.377367 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df970952-69a0-48aa-8236-7b6985f2980f None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330/users/42c3d6abafce4a929b4b6685de4943e5/roles/6be1975947cd4b948b86c73132244927` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:47.379516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df970952-69a0-48aa-8236-7b6985f2980f None admin] RBAC: Authorizing `identity:create_grant(project_id=7cf2243c0cdc44da93063ff4af6a2330, user_id=42c3d6abafce4a929b4b6685de4943e5, role_id=6be1975947cd4b948b86c73132244927)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:47.381084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df970952-69a0-48aa-8236-7b6985f2980f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:47.400793 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 52/108] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:10:47 2022] PUT /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330/users/42c3d6abafce4a929b4b6685de4943e5/roles/6be1975947cd4b948b86c73132244927 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:10:47.441833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80543148-156f-4a32-badc-184b86d23107 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:47.507729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc5262-4b6e-479c-a5a4-8ea3919424fd None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:47.508393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc5262-4b6e-479c-a5a4-8ea3919424fd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:47.508879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc5262-4b6e-479c-a5a4-8ea3919424fd None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:47.510550 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 53/109] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:47 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:47.517581 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dd4cc-f7cc-467f-9cd9-764520a1f5fc None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:47.518179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dd4cc-f7cc-467f-9cd9-764520a1f5fc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:47.518653 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dd4cc-f7cc-467f-9cd9-764520a1f5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:47.551166 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8b0dd4cc-f7cc-467f-9cd9-764520a1f5fc None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:47.552408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8b0dd4cc-f7cc-467f-9cd9-764520a1f5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:47.583721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80543148-156f-4a32-badc-184b86d23107 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:47.630686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5e94c-de87-48d2-b20b-878bc3aefc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:47.632252 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5e94c-de87-48d2-b20b-878bc3aefc90 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:47.632927 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5e94c-de87-48d2-b20b-878bc3aefc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:47.633443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5e94c-de87-48d2-b20b-878bc3aefc90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:47.634903 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5e94c-de87-48d2-b20b-878bc3aefc90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:47.636817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5e94c-de87-48d2-b20b-878bc3aefc90 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:47.638856 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 57/110] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:10:47 2022] GET /identity/v3/domains/default => generated 200 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:47.640683 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60b888-416d-4ed5-80a7-64d292eb79a2 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:47.641190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60b888-416d-4ed5-80a7-64d292eb79a2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:47.641663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60b888-416d-4ed5-80a7-64d292eb79a2 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:47.643381 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 58/111] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:47.644519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60b888-416d-4ed5-80a7-64d292eb79a2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:47.653996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 54/112] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:10:47.655541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dd4cc-f7cc-467f-9cd9-764520a1f5fc None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:47.693834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:47.778607 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dd4cc-f7cc-467f-9cd9-764520a1f5fc None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:47.791932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:47.801047 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60b888-416d-4ed5-80a7-64d292eb79a2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:47.824457 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912f5ed-5c50-4fc1-b6b3-aefe885916ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:47.825336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912f5ed-5c50-4fc1-b6b3-aefe885916ff None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:47.825757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912f5ed-5c50-4fc1-b6b3-aefe885916ff None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:47.826170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912f5ed-5c50-4fc1-b6b3-aefe885916ff None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:47.827067 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912f5ed-5c50-4fc1-b6b3-aefe885916ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:47.828821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912f5ed-5c50-4fc1-b6b3-aefe885916ff None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:47.838333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6e379-2c1c-4ce2-931e-a479b6e1b611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:47.838971 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6e379-2c1c-4ce2-931e-a479b6e1b611 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:47.839294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6e379-2c1c-4ce2-931e-a479b6e1b611 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:47.839996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6e379-2c1c-4ce2-931e-a479b6e1b611 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:47.862189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6e379-2c1c-4ce2-931e-a479b6e1b611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:47.864183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 55/113] 10.222.0.107 () {60 vars in 1146 bytes} [Tue Aug 23 23:10:47 2022] POST /identity/v3/projects => generated 303 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:10:47.867155 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4b9c7-794d-4677-a2d3-00080e9395ac None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:47.867644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4b9c7-794d-4677-a2d3-00080e9395ac None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:47.868061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4b9c7-794d-4677-a2d3-00080e9395ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:47.870196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-d4b6e379-2c1c-4ce2-931e-a479b6e1b611 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:10:47.870196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:47.870196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:47.870196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:47.870196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:47.870196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:47.870196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:47.870196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:47.870196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:47.870196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:47.870196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:47.870196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:47.870196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:47.870196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:47.870196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:47.870196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:47.871186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:47.871186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:47.871186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:47.871186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:47.871186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:47.871186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:47.871186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:47.871186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:47.871186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:47.871186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:47.871186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:47.871186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:47.871186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:47.871186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:47.871186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:47.871186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:47.872142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:47.872142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:47.872142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:47.872142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:47.872142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:47.872142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:47.872142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:47.872142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:47.872142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:47.872142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:47.872142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:10:47.872142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:10:47.872142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 59/114] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:10:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:47.879938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6e379-2c1c-4ce2-931e-a479b6e1b611 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:47.898848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e4a4b9c7-794d-4677-a2d3-00080e9395ac None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:47.900327 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e4a4b9c7-794d-4677-a2d3-00080e9395ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:47.981801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 56/115] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:47.998127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93fd01-e4fb-403e-af8c-cd9149b210db None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:47.998587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93fd01-e4fb-403e-af8c-cd9149b210db None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:47.999179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93fd01-e4fb-403e-af8c-cd9149b210db None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:48.003907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 57/116] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:47 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:10:48.007408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a68e1c-a42a-4bd8-8743-0567f7f8bf0a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:48.007850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a68e1c-a42a-4bd8-8743-0567f7f8bf0a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:48.008263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a68e1c-a42a-4bd8-8743-0567f7f8bf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:48.053490 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-93a68e1c-a42a-4bd8-8743-0567f7f8bf0a None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:48.054740 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-93a68e1c-a42a-4bd8-8743-0567f7f8bf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:48.075414 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:48.101836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6e379-2c1c-4ce2-931e-a479b6e1b611 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:48.147607 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb1f05-78fb-4e13-86a0-5b5ef700a967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:48.148775 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb1f05-78fb-4e13-86a0-5b5ef700a967 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:48.149027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb1f05-78fb-4e13-86a0-5b5ef700a967 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:48.149309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb1f05-78fb-4e13-86a0-5b5ef700a967 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:48.150069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb1f05-78fb-4e13-86a0-5b5ef700a967 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:48.150381 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb1f05-78fb-4e13-86a0-5b5ef700a967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:48.152664 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb1f05-78fb-4e13-86a0-5b5ef700a967 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:48.166049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 60/117] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:10:47 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:48.167020 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb1f05-78fb-4e13-86a0-5b5ef700a967 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:48.169696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 58/118] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:10:48.174925 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a68e1c-a42a-4bd8-8743-0567f7f8bf0a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:48.221834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:48.307259 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb1f05-78fb-4e13-86a0-5b5ef700a967 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:48.340342 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a68e1c-a42a-4bd8-8743-0567f7f8bf0a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:48.345654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46001f9e-1938-47d3-bed1-bc0281a174a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:48.346297 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46001f9e-1938-47d3-bed1-bc0281a174a8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:48.346579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46001f9e-1938-47d3-bed1-bc0281a174a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:48.346855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46001f9e-1938-47d3-bed1-bc0281a174a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:48.359045 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46001f9e-1938-47d3-bed1-bc0281a174a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:48.364898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-46001f9e-1938-47d3-bed1-bc0281a174a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:10:48.364898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:48.364898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:48.364898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:48.364898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:48.364898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:48.364898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:48.364898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:48.364898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:48.364898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:48.364898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:48.364898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:48.364898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:48.364898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:48.364898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:48.364898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:48.366052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:48.366052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:48.366052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:48.366052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:48.366052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:48.366052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:48.366052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:48.366052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:48.366052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:48.366052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:48.366052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:48.366052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:48.366052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:48.366052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:48.366052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:48.366052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:48.366810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:48.366810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:48.366810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:48.366810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:48.366810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:48.366810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:48.366810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:48.366810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:48.366810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:48.366810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:48.366810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:10:48.366810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:10:48.366810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 61/119] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:10:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:48.373414 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46001f9e-1938-47d3-bed1-bc0281a174a8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:48.391789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:48.404150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a32920-5365-4a35-845e-92ea1c2630dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:48.404903 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a32920-5365-4a35-845e-92ea1c2630dc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:48.405179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a32920-5365-4a35-845e-92ea1c2630dc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:48.405459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a32920-5365-4a35-845e-92ea1c2630dc None admin] PATH_INFO: `/v3/users/2eab0ecac24f459b83874b3f7a07599a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:48.429301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a32920-5365-4a35-845e-92ea1c2630dc None admin] RBAC: Authorizing `identity:get_user(user_id=2eab0ecac24f459b83874b3f7a07599a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:48.430781 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a32920-5365-4a35-845e-92ea1c2630dc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:48.432682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 59/120] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:48 2022] GET /identity/v3/users/2eab0ecac24f459b83874b3f7a07599a => generated 290 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:48.438133 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a32920-5365-4a35-845e-92ea1c2630dc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:48.486327 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46001f9e-1938-47d3-bed1-bc0281a174a8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:48.524669 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b5610-4448-4ebf-85ae-59be989ec668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:48.525299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b5610-4448-4ebf-85ae-59be989ec668 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:48.525587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b5610-4448-4ebf-85ae-59be989ec668 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:48.525869 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b5610-4448-4ebf-85ae-59be989ec668 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:48.526655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b5610-4448-4ebf-85ae-59be989ec668 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:48.526968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b5610-4448-4ebf-85ae-59be989ec668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:48.528472 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b5610-4448-4ebf-85ae-59be989ec668 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:48.537290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 62/121] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:10:48 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:48.543345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b5610-4448-4ebf-85ae-59be989ec668 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:48.570322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:48.594684 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a32920-5365-4a35-845e-92ea1c2630dc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:48.631705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d181ffa-a0f6-42a5-8b14-6999799a7510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:48.632342 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d181ffa-a0f6-42a5-8b14-6999799a7510 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:48.632475 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:48.632642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d181ffa-a0f6-42a5-8b14-6999799a7510 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:48.632900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d181ffa-a0f6-42a5-8b14-6999799a7510 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:48.659292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b5610-4448-4ebf-85ae-59be989ec668 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:48.696675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d25c1-7e6d-43b0-9841-abc794c25ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:48.698145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d25c1-7e6d-43b0-9841-abc794c25ffd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:48.698608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d25c1-7e6d-43b0-9841-abc794c25ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:48.699077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d25c1-7e6d-43b0-9841-abc794c25ffd None admin] PATH_INFO: `/v3/users/42c3d6abafce4a929b4b6685de4943e5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:48.700524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d25c1-7e6d-43b0-9841-abc794c25ffd None admin] RBAC: Authorizing `identity:get_user(user_id=42c3d6abafce4a929b4b6685de4943e5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:48.702308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d25c1-7e6d-43b0-9841-abc794c25ffd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:48.703332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d181ffa-a0f6-42a5-8b14-6999799a7510 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:48.704814 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d181ffa-a0f6-42a5-8b14-6999799a7510 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:48.705182 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 63/122] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:48 2022] GET /identity/v3/users/42c3d6abafce4a929b4b6685de4943e5 => generated 276 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:10:48.711644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d25c1-7e6d-43b0-9841-abc794c25ffd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:48.796369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:48.821900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 60/123] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:10:48 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:10:48.822677 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d181ffa-a0f6-42a5-8b14-6999799a7510 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:48.836931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d25c1-7e6d-43b0-9841-abc794c25ffd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:48.871857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcc3f0-a30b-4644-b1cb-fe8d18fbcff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:48.872491 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcc3f0-a30b-4644-b1cb-fe8d18fbcff3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:48.872811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcc3f0-a30b-4644-b1cb-fe8d18fbcff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:48.873538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcc3f0-a30b-4644-b1cb-fe8d18fbcff3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:48.880550 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:48.885528 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcc3f0-a30b-4644-b1cb-fe8d18fbcff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:48.891160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-a9dcc3f0-a30b-4644-b1cb-fe8d18fbcff3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:10:48.891160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:48.891160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:48.891160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:48.891160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:48.891160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:48.891160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:48.891160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:48.891160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:48.891160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:48.891160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:48.891160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:48.891160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:48.891160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:48.891160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:48.891160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:48.892187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:48.892187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:48.892187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:48.892187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:48.892187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:48.892187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:48.892187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:48.892187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:48.892187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:48.892187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:48.892187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:48.892187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:48.892187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:48.892187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:48.892187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:48.892187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:48.893159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:48.893159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:48.893159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:48.893159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:48.893159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:48.893159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:48.893159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:48.893159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:48.893159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:48.893159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:48.893159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:10:48.893159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:10:48.895295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 64/124] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:10:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:48.896147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcc3f0-a30b-4644-b1cb-fe8d18fbcff3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:48.949525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d181ffa-a0f6-42a5-8b14-6999799a7510 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:48.989053 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6d465-7021-4fd5-9603-892ab877ad67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:48.989934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6d465-7021-4fd5-9603-892ab877ad67 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:48.994411 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6d465-7021-4fd5-9603-892ab877ad67 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:48.994929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6d465-7021-4fd5-9603-892ab877ad67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:49.010740 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6d465-7021-4fd5-9603-892ab877ad67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:49.018151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-10d6d465-7021-4fd5-9603-892ab877ad67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:10:49.018151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:49.018151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:49.018151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:49.018151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:49.018151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:49.018151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:49.018151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:49.018151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:49.018151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:49.018151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:49.018151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:49.018151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:49.018151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:49.018151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:49.018151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:49.019180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:49.019180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:49.019180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:49.019180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:49.019180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:49.019180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:49.019180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:49.019180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:49.019180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:49.019180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:49.019180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:49.019180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:49.019180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:49.019180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:49.019180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:49.019180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:49.020093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:49.020093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:49.020093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:49.020093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:49.020093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:49.020093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:49.020093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:49.020093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:49.020093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:49.020093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:49.020093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:10:49.020093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:10:49.022101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 61/125] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:10:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:49.023994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6d465-7021-4fd5-9603-892ab877ad67 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:49.027538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcc3f0-a30b-4644-b1cb-fe8d18fbcff3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:49.072562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025eb29-c03a-4947-946e-cfbd6f37377a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:49.073192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025eb29-c03a-4947-946e-cfbd6f37377a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:49.073474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025eb29-c03a-4947-946e-cfbd6f37377a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:49.073752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025eb29-c03a-4947-946e-cfbd6f37377a None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:49.074889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025eb29-c03a-4947-946e-cfbd6f37377a None admin] RBAC: Authorizing `identity:get_project(project_id=7cf2243c0cdc44da93063ff4af6a2330)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:49.076478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025eb29-c03a-4947-946e-cfbd6f37377a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:49.082576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 65/126] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:10:48 2022] GET /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330 => generated 299 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:49.082576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025eb29-c03a-4947-946e-cfbd6f37377a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:49.083793 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:49.158201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6d465-7021-4fd5-9603-892ab877ad67 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:49.167130 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:49.195404 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204c141-6dd1-4350-95b4-70b5bbdf161c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:49.195868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204c141-6dd1-4350-95b4-70b5bbdf161c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:49.196149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204c141-6dd1-4350-95b4-70b5bbdf161c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:49.196423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204c141-6dd1-4350-95b4-70b5bbdf161c None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:49.197755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204c141-6dd1-4350-95b4-70b5bbdf161c None admin] RBAC: Authorizing `identity:get_project(project_id=7cf2243c0cdc44da93063ff4af6a2330)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:49.199211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204c141-6dd1-4350-95b4-70b5bbdf161c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:49.201031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 62/127] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:10:49 2022] GET /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330 => generated 299 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:49.201720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204c141-6dd1-4350-95b4-70b5bbdf161c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:49.211375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025eb29-c03a-4947-946e-cfbd6f37377a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:49.249518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c1bf4-137b-423d-ae13-c61a4bdea1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:49.250506 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c1bf4-137b-423d-ae13-c61a4bdea1cd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:49.250994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c1bf4-137b-423d-ae13-c61a4bdea1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:49.251514 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c1bf4-137b-423d-ae13-c61a4bdea1cd None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:49.252483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c1bf4-137b-423d-ae13-c61a4bdea1cd None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:49.253018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c1bf4-137b-423d-ae13-c61a4bdea1cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:49.254705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c1bf4-137b-423d-ae13-c61a4bdea1cd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:49.264656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 66/128] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:10:49 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:49.265867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c1bf4-137b-423d-ae13-c61a4bdea1cd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:49.317957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204c141-6dd1-4350-95b4-70b5bbdf161c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:49.328919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:49.357316 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50e791-7317-4ba5-8126-330f3a6023c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:49.358307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50e791-7317-4ba5-8126-330f3a6023c0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:49.358651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50e791-7317-4ba5-8126-330f3a6023c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:49.359047 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50e791-7317-4ba5-8126-330f3a6023c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:49.359793 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50e791-7317-4ba5-8126-330f3a6023c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:49.360186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50e791-7317-4ba5-8126-330f3a6023c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:49.361722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50e791-7317-4ba5-8126-330f3a6023c0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:49.371658 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 63/129] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:10:49 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:49.372627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50e791-7317-4ba5-8126-330f3a6023c0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:49.386313 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c1bf4-137b-423d-ae13-c61a4bdea1cd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:49.424146 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:49.436637 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db61a0d-4ad1-4508-8428-117c6028c465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:49.437458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db61a0d-4ad1-4508-8428-117c6028c465 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:49.437803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db61a0d-4ad1-4508-8428-117c6028c465 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:49.438145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db61a0d-4ad1-4508-8428-117c6028c465 None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330/users/42c3d6abafce4a929b4b6685de4943e5/roles/8801d305c8374d34abe896d3b7685174` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:49.441589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db61a0d-4ad1-4508-8428-117c6028c465 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cf2243c0cdc44da93063ff4af6a2330, user_id=42c3d6abafce4a929b4b6685de4943e5, role_id=8801d305c8374d34abe896d3b7685174)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:49.443994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db61a0d-4ad1-4508-8428-117c6028c465 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:49.475366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 67/130] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:10:49 2022] PUT /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330/users/42c3d6abafce4a929b4b6685de4943e5/roles/8801d305c8374d34abe896d3b7685174 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:10:49.476247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db61a0d-4ad1-4508-8428-117c6028c465 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:49.544708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50e791-7317-4ba5-8126-330f3a6023c0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:49.619126 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db61a0d-4ad1-4508-8428-117c6028c465 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:49.657384 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e1e01-2894-4438-8c2b-1123bd894d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:49.658052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e1e01-2894-4438-8c2b-1123bd894d97 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:49.658336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e1e01-2894-4438-8c2b-1123bd894d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:49.658609 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e1e01-2894-4438-8c2b-1123bd894d97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:49.659353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e1e01-2894-4438-8c2b-1123bd894d97 None admin] RBAC: Adding query filter params (role.id=3d0598848b8f4a18917b5dbb657caa63, scope.project.id=7cf2243c0cdc44da93063ff4af6a2330, user.id=2eab0ecac24f459b83874b3f7a07599a) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:49.659701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e1e01-2894-4438-8c2b-1123bd894d97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:49.661150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e1e01-2894-4438-8c2b-1123bd894d97 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:49.667513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a48c53-2853-4e93-a161-0e13a3895af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:49.668508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a48c53-2853-4e93-a161-0e13a3895af5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:49.669041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a48c53-2853-4e93-a161-0e13a3895af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:49.669512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a48c53-2853-4e93-a161-0e13a3895af5 None admin] PATH_INFO: `/v3/users/42c3d6abafce4a929b4b6685de4943e5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:49.671613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a48c53-2853-4e93-a161-0e13a3895af5 None admin] RBAC: Authorizing `identity:get_user(user_id=42c3d6abafce4a929b4b6685de4943e5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:49.673563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a48c53-2853-4e93-a161-0e13a3895af5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:49.675511 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 64/131] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:10:49 2022] GET /identity/v3/role_assignments?user.id=2eab0ecac24f459b83874b3f7a07599a&scope.project.id=7cf2243c0cdc44da93063ff4af6a2330&role.id=3d0598848b8f4a18917b5dbb657caa63 => generated 260 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:49.675832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 68/132] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:49 2022] GET /identity/v3/users/42c3d6abafce4a929b4b6685de4943e5 => generated 276 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:49.676366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e1e01-2894-4438-8c2b-1123bd894d97 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:49.702209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a48c53-2853-4e93-a161-0e13a3895af5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:49.745758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:49.778478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:49.828557 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e1e01-2894-4438-8c2b-1123bd894d97 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:49.847002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a48c53-2853-4e93-a161-0e13a3895af5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:49.869470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6937f-b7d8-4a2c-8f89-0e2acc41590a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:49.870038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6937f-b7d8-4a2c-8f89-0e2acc41590a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:49.870320 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6937f-b7d8-4a2c-8f89-0e2acc41590a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:49.870618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6937f-b7d8-4a2c-8f89-0e2acc41590a None admin] PATH_INFO: `/v3/users/7dbee4330ce74aedb00eece717c969c5` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:49.871739 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6937f-b7d8-4a2c-8f89-0e2acc41590a None admin] RBAC: Authorizing `identity:get_user(user_id=7dbee4330ce74aedb00eece717c969c5)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:49.873231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6937f-b7d8-4a2c-8f89-0e2acc41590a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:49.874854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 65/133] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:49 2022] GET /identity/v3/users/7dbee4330ce74aedb00eece717c969c5 => generated 248 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:49.881531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed359a3-5edc-4a12-87b0-1789bc6d6af9 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:49.881825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed359a3-5edc-4a12-87b0-1789bc6d6af9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:49.882101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed359a3-5edc-4a12-87b0-1789bc6d6af9 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:49.886942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 66/134] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:49 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:49.886942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed359a3-5edc-4a12-87b0-1789bc6d6af9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:49.908663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724da3c4-2227-486c-b865-680a86db434c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:49.909653 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724da3c4-2227-486c-b865-680a86db434c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:49.910116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724da3c4-2227-486c-b865-680a86db434c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:49.910571 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724da3c4-2227-486c-b865-680a86db434c None admin] PATH_INFO: `/v3/projects/b88f11b3ef5444f9b22ed43d4a86d7d3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:49.912115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724da3c4-2227-486c-b865-680a86db434c None admin] RBAC: Authorizing `identity:get_project(project_id=b88f11b3ef5444f9b22ed43d4a86d7d3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:49.914734 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724da3c4-2227-486c-b865-680a86db434c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:49.918104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 69/135] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:10:49 2022] GET /identity/v3/projects/b88f11b3ef5444f9b22ed43d4a86d7d3 => generated 313 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:10:49.920440 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40382186-0b71-4c53-8539-698580c5380b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:49.920928 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40382186-0b71-4c53-8539-698580c5380b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:49.921447 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40382186-0b71-4c53-8539-698580c5380b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:49.943090 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-40382186-0b71-4c53-8539-698580c5380b None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:49.944678 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-40382186-0b71-4c53-8539-698580c5380b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:50.076788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 70/136] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:50.077826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40382186-0b71-4c53-8539-698580c5380b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:50.114587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed359a3-5edc-4a12-87b0-1789bc6d6af9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:50.116427 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:50.144529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:50.196376 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40382186-0b71-4c53-8539-698580c5380b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:50.201361 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66317df8-8bec-477b-9e0b-ce820e1975f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:50.202024 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66317df8-8bec-477b-9e0b-ce820e1975f5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:50.202311 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66317df8-8bec-477b-9e0b-ce820e1975f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:50.202591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66317df8-8bec-477b-9e0b-ce820e1975f5 None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:50.203802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66317df8-8bec-477b-9e0b-ce820e1975f5 None admin] RBAC: Authorizing `identity:get_project(project_id=7cf2243c0cdc44da93063ff4af6a2330)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:50.205473 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66317df8-8bec-477b-9e0b-ce820e1975f5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:50.207307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 67/137] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:10:49 2022] GET /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330 => generated 299 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:50.213316 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66317df8-8bec-477b-9e0b-ce820e1975f5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:50.237812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b18c8-d064-4491-804d-49f542de6c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:50.238883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b18c8-d064-4491-804d-49f542de6c78 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:50.239469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b18c8-d064-4491-804d-49f542de6c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:50.239947 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b18c8-d064-4491-804d-49f542de6c78 None admin] PATH_INFO: `/v3/projects/b88f11b3ef5444f9b22ed43d4a86d7d3/users/42c3d6abafce4a929b4b6685de4943e5/roles/6be1975947cd4b948b86c73132244927` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:50.243192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b18c8-d064-4491-804d-49f542de6c78 None admin] RBAC: Authorizing `identity:create_grant(project_id=b88f11b3ef5444f9b22ed43d4a86d7d3, user_id=42c3d6abafce4a929b4b6685de4943e5, role_id=6be1975947cd4b948b86c73132244927)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:50.245141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b18c8-d064-4491-804d-49f542de6c78 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:50.267233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 71/138] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:10:50 2022] PUT /identity/v3/projects/b88f11b3ef5444f9b22ed43d4a86d7d3/users/42c3d6abafce4a929b4b6685de4943e5/roles/6be1975947cd4b948b86c73132244927 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:10:50.390734 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66317df8-8bec-477b-9e0b-ce820e1975f5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:50.443359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e350f08-c7ae-4fcf-a5e6-d0eb38323248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:50.444126 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e350f08-c7ae-4fcf-a5e6-d0eb38323248 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:50.444650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e350f08-c7ae-4fcf-a5e6-d0eb38323248 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:50.444971 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e350f08-c7ae-4fcf-a5e6-d0eb38323248 None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330/users/7dbee4330ce74aedb00eece717c969c5/roles/97ece22f2e264e0e857d5107325a85d9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:50.449507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e350f08-c7ae-4fcf-a5e6-d0eb38323248 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cf2243c0cdc44da93063ff4af6a2330, user_id=7dbee4330ce74aedb00eece717c969c5, role_id=97ece22f2e264e0e857d5107325a85d9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:50.451007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e350f08-c7ae-4fcf-a5e6-d0eb38323248 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:50.466584 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 68/139] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:10:50 2022] PUT /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330/users/7dbee4330ce74aedb00eece717c969c5/roles/97ece22f2e264e0e857d5107325a85d9 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:10:50.489283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b18c8-d064-4491-804d-49f542de6c78 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:50.622504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b18c8-d064-4491-804d-49f542de6c78 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:50.640408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:50.646219 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd035f4-890d-45c9-a57e-65cc21996226 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:50.646531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd035f4-890d-45c9-a57e-65cc21996226 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:50.649384 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd035f4-890d-45c9-a57e-65cc21996226 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:50.649384 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 69/140] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:50.658281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934fa96-8492-4f25-aa28-5ff5f2f4c7b4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:50.658579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934fa96-8492-4f25-aa28-5ff5f2f4c7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:50.658845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934fa96-8492-4f25-aa28-5ff5f2f4c7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:50.664410 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f60038-d968-4fcd-b2fe-3e76db616675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:50.665121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f60038-d968-4fcd-b2fe-3e76db616675 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:50.665738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f60038-d968-4fcd-b2fe-3e76db616675 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:50.665998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f60038-d968-4fcd-b2fe-3e76db616675 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:50.679818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f60038-d968-4fcd-b2fe-3e76db616675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:50.684918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-07f60038-d968-4fcd-b2fe-3e76db616675 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:10:50.684918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:50.684918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:50.684918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:50.684918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:50.684918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:50.684918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:50.684918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:50.684918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:50.684918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:50.684918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:50.684918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:50.684918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:50.684918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:50.684918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:50.684918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:50.685829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:50.685829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:50.685829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:50.685829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:50.685829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:50.685829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:50.685829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:50.685829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:50.685829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:50.685829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:50.685829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:50.685829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:50.685829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:50.685829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:50.685829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:50.685829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:50.686995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:50.686995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:50.686995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:50.686995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:50.686995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:50.686995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:50.686995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:50.686995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:50.686995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:50.686995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:50.686995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:10:50.686995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:10:50.686995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 72/141] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:10:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:50.692404 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f60038-d968-4fcd-b2fe-3e76db616675 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:50.701779 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9934fa96-8492-4f25-aa28-5ff5f2f4c7b4 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:50.703036 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9934fa96-8492-4f25-aa28-5ff5f2f4c7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:50.739828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:50.853106 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f60038-d968-4fcd-b2fe-3e76db616675 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:50.861940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 70/142] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:50.922243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31102a01-865d-4634-a861-2ad1d934cf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:50.923207 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31102a01-865d-4634-a861-2ad1d934cf46 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:50.923722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31102a01-865d-4634-a861-2ad1d934cf46 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:50.924181 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31102a01-865d-4634-a861-2ad1d934cf46 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:50.925080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31102a01-865d-4634-a861-2ad1d934cf46 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:50.925570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31102a01-865d-4634-a861-2ad1d934cf46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:50.927138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31102a01-865d-4634-a861-2ad1d934cf46 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:50.940130 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 73/143] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:10:50 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:10:50.946340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934fa96-8492-4f25-aa28-5ff5f2f4c7b4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:51.100518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934fa96-8492-4f25-aa28-5ff5f2f4c7b4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:51.144088 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab271bf-69c1-460a-a29c-fc9f4a1ae753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:51.144759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab271bf-69c1-460a-a29c-fc9f4a1ae753 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:51.145044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab271bf-69c1-460a-a29c-fc9f4a1ae753 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:51.145321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab271bf-69c1-460a-a29c-fc9f4a1ae753 None admin] PATH_INFO: `/v3/users/42c3d6abafce4a929b4b6685de4943e5` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:51.149304 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab271bf-69c1-460a-a29c-fc9f4a1ae753 None admin] RBAC: Authorizing `identity:get_user(user_id=42c3d6abafce4a929b4b6685de4943e5)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:51.150765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab271bf-69c1-460a-a29c-fc9f4a1ae753 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:51.152552 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 71/144] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:50 2022] GET /identity/v3/users/42c3d6abafce4a929b4b6685de4943e5 => generated 276 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:51.158078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31102a01-865d-4634-a861-2ad1d934cf46 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:51.214041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:51.286349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31102a01-865d-4634-a861-2ad1d934cf46 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:51.323367 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1affb4-be1b-46c9-bca1-60c7332226e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:51.323984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1affb4-be1b-46c9-bca1-60c7332226e4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:51.324267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1affb4-be1b-46c9-bca1-60c7332226e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:51.324545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1affb4-be1b-46c9-bca1-60c7332226e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:51.398245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab271bf-69c1-460a-a29c-fc9f4a1ae753 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:51.411421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1affb4-be1b-46c9-bca1-60c7332226e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:51.413569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1affb4-be1b-46c9-bca1-60c7332226e4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:51.476165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:51.491205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:51.550776 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 74/145] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:10:51 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:10:51.557606 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1affb4-be1b-46c9-bca1-60c7332226e4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:51.691418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1affb4-be1b-46c9-bca1-60c7332226e4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:51.697239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab271bf-69c1-460a-a29c-fc9f4a1ae753 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:51.763308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92512b21-b83e-4482-94dd-0bf155d90038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:51.763939 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92512b21-b83e-4482-94dd-0bf155d90038 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:51.764218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92512b21-b83e-4482-94dd-0bf155d90038 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:51.764492 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92512b21-b83e-4482-94dd-0bf155d90038 None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:51.766028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5ca5b-da75-42fc-b7a3-4762571ef2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:51.767301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92512b21-b83e-4482-94dd-0bf155d90038 None admin] RBAC: Authorizing `identity:get_project(project_id=7cf2243c0cdc44da93063ff4af6a2330)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:51.767991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5ca5b-da75-42fc-b7a3-4762571ef2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:51.768268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5ca5b-da75-42fc-b7a3-4762571ef2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:51.768537 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5ca5b-da75-42fc-b7a3-4762571ef2f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:51.770083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92512b21-b83e-4482-94dd-0bf155d90038 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:51.772260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 75/146] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:10:51 2022] GET /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330 => generated 299 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:51.773041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5ca5b-da75-42fc-b7a3-4762571ef2f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:51.774482 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5ca5b-da75-42fc-b7a3-4762571ef2f5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:51.776200 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 72/147] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:10:51 2022] GET /identity/v3/domains/default => generated 200 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:51.781626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92512b21-b83e-4482-94dd-0bf155d90038 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:51.782778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5ca5b-da75-42fc-b7a3-4762571ef2f5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:51.790201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:52.010769 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92512b21-b83e-4482-94dd-0bf155d90038 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:52.015572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:52.028465 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5ca5b-da75-42fc-b7a3-4762571ef2f5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:52.091712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac190a32-db0e-4c29-9f5e-7115bdaa1d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:52.092337 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac190a32-db0e-4c29-9f5e-7115bdaa1d3d None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:52.092631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac190a32-db0e-4c29-9f5e-7115bdaa1d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:52.092908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac190a32-db0e-4c29-9f5e-7115bdaa1d3d None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:52.093561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac190a32-db0e-4c29-9f5e-7115bdaa1d3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:52.094999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac190a32-db0e-4c29-9f5e-7115bdaa1d3d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:52.097915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5d8e7-e96b-46db-afc4-94fddebf5510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:52.098576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5d8e7-e96b-46db-afc4-94fddebf5510 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:52.098864 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5d8e7-e96b-46db-afc4-94fddebf5510 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:52.099143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5d8e7-e96b-46db-afc4-94fddebf5510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:52.100487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5d8e7-e96b-46db-afc4-94fddebf5510 None admin] RBAC: Adding query filter params (role.id=6be1975947cd4b948b86c73132244927, scope.project.id=7cf2243c0cdc44da93063ff4af6a2330, user.id=42c3d6abafce4a929b4b6685de4943e5) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:52.100817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5d8e7-e96b-46db-afc4-94fddebf5510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:52.102255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5d8e7-e96b-46db-afc4-94fddebf5510 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:52.117832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 76/148] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:10:51 2022] GET /identity/v3/role_assignments?user.id=42c3d6abafce4a929b4b6685de4943e5&scope.project.id=7cf2243c0cdc44da93063ff4af6a2330&role.id=6be1975947cd4b948b86c73132244927 => generated 610 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:52.143176 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 73/149] 10.222.0.107 () {60 vars in 1137 bytes} [Tue Aug 23 23:10:51 2022] POST /identity/v3/users => generated 284 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:10:52.529708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acfcc2-46a2-44f8-8713-a170a054bc27 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:52.529989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acfcc2-46a2-44f8-8713-a170a054bc27 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:52.530257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acfcc2-46a2-44f8-8713-a170a054bc27 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:52.531934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 77/150] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:52.538195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae24a41-f7f7-4008-b212-b69a577eea3f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:52.538673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae24a41-f7f7-4008-b212-b69a577eea3f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:52.539131 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae24a41-f7f7-4008-b212-b69a577eea3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:52.559691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6ae24a41-f7f7-4008-b212-b69a577eea3f None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:52.560905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6ae24a41-f7f7-4008-b212-b69a577eea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:52.653739 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 74/151] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:52.838805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea1b0b-7f87-42ba-bb3e-47eea8ecbb9c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:52.839007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea1b0b-7f87-42ba-bb3e-47eea8ecbb9c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:52.839453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea1b0b-7f87-42ba-bb3e-47eea8ecbb9c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:52.840977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 78/152] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:52.846392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fce298-866c-4aa8-b557-e25dc441084f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:52.846796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fce298-866c-4aa8-b557-e25dc441084f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:52.847195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fce298-866c-4aa8-b557-e25dc441084f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:52.870233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-77fce298-866c-4aa8-b557-e25dc441084f None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:52.871439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-77fce298-866c-4aa8-b557-e25dc441084f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:52.958709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 75/153] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:53.001545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea1b0b-7f87-42ba-bb3e-47eea8ecbb9c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:53.035209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd92c1b-e372-4903-9c4c-24a134f3f25e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:53.036075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd92c1b-e372-4903-9c4c-24a134f3f25e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:53.036348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd92c1b-e372-4903-9c4c-24a134f3f25e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:53.037798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 76/154] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:53.053790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbd96c-8061-4b4e-9f6d-264d22361263 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:53.054310 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbd96c-8061-4b4e-9f6d-264d22361263 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:53.054734 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbd96c-8061-4b4e-9f6d-264d22361263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:53.080894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4cbbd96c-8061-4b4e-9f6d-264d22361263 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:53.082113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4cbbd96c-8061-4b4e-9f6d-264d22361263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:53.087679 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:53.095712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:53.138198 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea1b0b-7f87-42ba-bb3e-47eea8ecbb9c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:53.186221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d70e2e-b272-4db5-a24c-e2902b1504c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:53.187266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d70e2e-b272-4db5-a24c-e2902b1504c6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:53.187750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d70e2e-b272-4db5-a24c-e2902b1504c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:53.188225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d70e2e-b272-4db5-a24c-e2902b1504c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:53.189623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 77/155] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:10:53.200867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d70e2e-b272-4db5-a24c-e2902b1504c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:53.206269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-72d70e2e-b272-4db5-a24c-e2902b1504c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:10:53.206269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:53.206269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:53.206269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:53.206269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:53.206269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:53.206269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:53.206269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:53.206269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:53.206269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:53.206269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:53.206269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:53.206269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:53.206269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:53.206269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:53.206269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:53.207290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:53.207290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:53.207290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:53.207290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:53.207290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:53.207290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:53.207290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:53.207290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:53.207290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:53.207290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:53.207290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:53.207290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:53.207290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:53.207290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:53.207290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:53.207290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:53.208080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:53.208080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:53.208080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:53.208080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:53.208080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:53.208080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:53.208080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:53.208080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:53.208080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:53.208080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:53.208080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:10:53.208080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:10:53.209017 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 79/156] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:10:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:53.215018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbd96c-8061-4b4e-9f6d-264d22361263 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:53.232240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a2ebf-5a5b-490e-b1d4-350ba7506f76 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:53.232565 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a2ebf-5a5b-490e-b1d4-350ba7506f76 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:53.235597 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a2ebf-5a5b-490e-b1d4-350ba7506f76 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:53.237728 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 80/157] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:53 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:53.246670 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24f5a7-d677-42bd-9499-72e536bb8ea7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:53.247228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24f5a7-d677-42bd-9499-72e536bb8ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:53.247603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24f5a7-d677-42bd-9499-72e536bb8ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:53.269121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-cf24f5a7-d677-42bd-9499-72e536bb8ea7 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:53.270857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cf24f5a7-d677-42bd-9499-72e536bb8ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:53.359916 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 81/158] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:53.375815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24f5a7-d677-42bd-9499-72e536bb8ea7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:53.430869 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbd96c-8061-4b4e-9f6d-264d22361263 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:53.496448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:53.505782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5aeba7-2939-45f6-ad25-9044316dfbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:53.507059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aeba7-2939-45f6-ad25-9044316dfbcb None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:53.507532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aeba7-2939-45f6-ad25-9044316dfbcb None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:53.507870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aeba7-2939-45f6-ad25-9044316dfbcb None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:53.508559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5aeba7-2939-45f6-ad25-9044316dfbcb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:53.508889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5aeba7-2939-45f6-ad25-9044316dfbcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:53.510304 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5aeba7-2939-45f6-ad25-9044316dfbcb None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:53.528807 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 78/159] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:10:53 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:53.529992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5aeba7-2939-45f6-ad25-9044316dfbcb None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:53.541684 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:53.585760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24f5a7-d677-42bd-9499-72e536bb8ea7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:53.635382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba04ca-58dc-4e91-9ee9-f625201221ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:53.636041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba04ca-58dc-4e91-9ee9-f625201221ca None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:53.636322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba04ca-58dc-4e91-9ee9-f625201221ca None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:53.636702 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba04ca-58dc-4e91-9ee9-f625201221ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:53.652166 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba04ca-58dc-4e91-9ee9-f625201221ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:53.658204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-eaba04ca-58dc-4e91-9ee9-f625201221ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:10:53.658204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:53.658204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:53.658204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:53.658204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:53.658204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:53.658204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:53.658204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:53.658204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:53.658204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:53.658204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:53.658204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:53.658204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:53.658204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:53.658204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:53.658204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:53.659231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:53.659231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:53.659231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:53.659231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:53.659231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:53.659231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:53.659231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:53.659231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:53.659231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:53.659231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:53.659231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:53.659231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:53.659231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:53.659231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:53.659231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:53.659231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:53.660022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:53.660022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:53.660022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:53.660022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:53.660022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:53.660022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:53.660022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:53.660022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:53.660022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:53.660022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:53.660022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:10:53.660022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:10:53.660022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 82/160] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:10:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:10:53.661475 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba04ca-58dc-4e91-9ee9-f625201221ca None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:53.676066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5aeba7-2939-45f6-ad25-9044316dfbcb None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:53.726813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736fdd9-f47e-4056-832d-184451e7f31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:53.727945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736fdd9-f47e-4056-832d-184451e7f31d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:53.728517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736fdd9-f47e-4056-832d-184451e7f31d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:53.728827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736fdd9-f47e-4056-832d-184451e7f31d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:53.745943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736fdd9-f47e-4056-832d-184451e7f31d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:53.753371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-9736fdd9-f47e-4056-832d-184451e7f31d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:10:53.753371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:53.753371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:53.753371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:53.753371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:53.753371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:53.753371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:53.753371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:53.753371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:53.753371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:53.753371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:53.753371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:53.753371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:53.753371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:53.753371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:53.753371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:53.754245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:53.754245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:53.754245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:53.754245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:53.754245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:53.754245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:53.754245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:53.754245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:53.754245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:53.754245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:53.754245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:53.754245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:53.754245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:53.754245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:53.754245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:53.754245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:53.755074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:53.755074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:53.755074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:53.755074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:53.755074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:53.755074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:53.755074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:53.755074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:53.755074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:53.755074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:53.755074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:10:53.755074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:10:53.755074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 79/161] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:10:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:53.757048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736fdd9-f47e-4056-832d-184451e7f31d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:53.788171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba04ca-58dc-4e91-9ee9-f625201221ca None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:53.829027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:53.844088 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:53.847070 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652ef38-4ed3-4867-a78f-1418facba585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:53.847770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652ef38-4ed3-4867-a78f-1418facba585 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:53.848054 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652ef38-4ed3-4867-a78f-1418facba585 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:53.848339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652ef38-4ed3-4867-a78f-1418facba585 None admin] PATH_INFO: `/v3/users/42c3d6abafce4a929b4b6685de4943e5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:53.852053 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652ef38-4ed3-4867-a78f-1418facba585 None admin] RBAC: Authorizing `identity:get_user(user_id=42c3d6abafce4a929b4b6685de4943e5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:53.853574 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652ef38-4ed3-4867-a78f-1418facba585 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:53.855740 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 83/162] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:53 2022] GET /identity/v3/users/42c3d6abafce4a929b4b6685de4943e5 => generated 276 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:53.868989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652ef38-4ed3-4867-a78f-1418facba585 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:53.888616 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736fdd9-f47e-4056-832d-184451e7f31d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:53.928578 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b75b5-df64-40bf-9d15-a1977110e4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:53.929229 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b75b5-df64-40bf-9d15-a1977110e4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:53.929533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b75b5-df64-40bf-9d15-a1977110e4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:53.929809 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b75b5-df64-40bf-9d15-a1977110e4a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:53.930901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b75b5-df64-40bf-9d15-a1977110e4a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:53.931215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b75b5-df64-40bf-9d15-a1977110e4a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:53.932873 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b75b5-df64-40bf-9d15-a1977110e4a4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:53.943229 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 80/163] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:10:53 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:53.944690 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b75b5-df64-40bf-9d15-a1977110e4a4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:54.057878 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b75b5-df64-40bf-9d15-a1977110e4a4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:54.093180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:54.097332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c7a25-2246-4f96-b28f-c07ea114c576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:54.097964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c7a25-2246-4f96-b28f-c07ea114c576 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:54.098248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c7a25-2246-4f96-b28f-c07ea114c576 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:54.098528 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c7a25-2246-4f96-b28f-c07ea114c576 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:54.099206 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c7a25-2246-4f96-b28f-c07ea114c576 None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:54.099519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c7a25-2246-4f96-b28f-c07ea114c576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:54.101794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c7a25-2246-4f96-b28f-c07ea114c576 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:54.114944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 81/164] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:10:53 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:54.116429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c7a25-2246-4f96-b28f-c07ea114c576 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:54.158651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652ef38-4ed3-4867-a78f-1418facba585 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:54.217989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08bc3e-4fe7-45a4-830d-798524fb34d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:54.218636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08bc3e-4fe7-45a4-830d-798524fb34d3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:54.218909 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08bc3e-4fe7-45a4-830d-798524fb34d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:54.219177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08bc3e-4fe7-45a4-830d-798524fb34d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:54.231386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08bc3e-4fe7-45a4-830d-798524fb34d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:54.236247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8d08bc3e-4fe7-45a4-830d-798524fb34d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:10:54.236247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:54.236247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:54.236247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:54.236247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:54.236247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:54.236247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:54.236247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:54.236247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:54.236247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:54.236247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:54.236247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:54.236247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:54.236247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:54.236247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:54.236247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:54.237439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:54.237439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:54.237439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:54.237439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:54.237439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:54.237439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:54.237439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:54.237439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:54.237439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:54.237439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:54.237439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:54.237439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:54.237439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:54.237439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:54.237439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:54.237439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:54.238237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:54.238237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:54.238237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:54.238237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:54.238237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:54.238237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:54.238237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:54.238237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:54.238237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:54.238237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:54.238237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:10:54.238237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:10:54.238934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c7a25-2246-4f96-b28f-c07ea114c576 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:54.243232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 84/165] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:10:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:54.244157 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08bc3e-4fe7-45a4-830d-798524fb34d3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:54.281721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c543d-e72c-42a3-a863-96a7eb8eb0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:54.282545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c543d-e72c-42a3-a863-96a7eb8eb0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:54.282934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c543d-e72c-42a3-a863-96a7eb8eb0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:54.283328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c543d-e72c-42a3-a863-96a7eb8eb0e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:54.360554 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c543d-e72c-42a3-a863-96a7eb8eb0e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:54.362635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c543d-e72c-42a3-a863-96a7eb8eb0e7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:54.377000 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:54.379691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:54.476661 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 82/166] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:10:54 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:10:54.477600 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c543d-e72c-42a3-a863-96a7eb8eb0e7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:54.590627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08bc3e-4fe7-45a4-830d-798524fb34d3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:54.592356 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c543d-e72c-42a3-a863-96a7eb8eb0e7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:54.603976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:54.633667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688db51-b7a1-4b67-bc1d-b913761bfdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:54.634404 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688db51-b7a1-4b67-bc1d-b913761bfdfe None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:54.634687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688db51-b7a1-4b67-bc1d-b913761bfdfe None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:54.634953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688db51-b7a1-4b67-bc1d-b913761bfdfe None admin] PATH_INFO: `/v3/users/42c3d6abafce4a929b4b6685de4943e5` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:54.636128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688db51-b7a1-4b67-bc1d-b913761bfdfe None admin] RBAC: Authorizing `identity:get_user(user_id=42c3d6abafce4a929b4b6685de4943e5)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:54.637679 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688db51-b7a1-4b67-bc1d-b913761bfdfe None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:54.639474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 83/167] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:54 2022] GET /identity/v3/users/42c3d6abafce4a929b4b6685de4943e5 => generated 276 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:54.640807 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688db51-b7a1-4b67-bc1d-b913761bfdfe None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:54.711966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b022a-2f5c-45cf-9f92-f4550304db5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:54.712633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b022a-2f5c-45cf-9f92-f4550304db5a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:54.712911 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b022a-2f5c-45cf-9f92-f4550304db5a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:54.713181 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b022a-2f5c-45cf-9f92-f4550304db5a None admin] PATH_INFO: `/v3/users/2eab0ecac24f459b83874b3f7a07599a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:54.714358 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b022a-2f5c-45cf-9f92-f4550304db5a None admin] RBAC: Authorizing `identity:get_user(user_id=2eab0ecac24f459b83874b3f7a07599a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:54.715809 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b022a-2f5c-45cf-9f92-f4550304db5a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:54.717441 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 85/168] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:54 2022] GET /identity/v3/users/2eab0ecac24f459b83874b3f7a07599a => generated 290 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:54.729766 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b022a-2f5c-45cf-9f92-f4550304db5a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:54.772718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688db51-b7a1-4b67-bc1d-b913761bfdfe None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:54.881358 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb6080-bd7a-4b74-b2ce-ee844cb61d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:54.882058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb6080-bd7a-4b74-b2ce-ee844cb61d18 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:54.882270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb6080-bd7a-4b74-b2ce-ee844cb61d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:54.882548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb6080-bd7a-4b74-b2ce-ee844cb61d18 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:54.883233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb6080-bd7a-4b74-b2ce-ee844cb61d18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:54.883542 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb6080-bd7a-4b74-b2ce-ee844cb61d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:54.884980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb6080-bd7a-4b74-b2ce-ee844cb61d18 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:54.885276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b022a-2f5c-45cf-9f92-f4550304db5a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:54.902408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:54.906502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 84/169] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:10:54 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:54.907443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb6080-bd7a-4b74-b2ce-ee844cb61d18 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:54.942424 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:54.943396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06458c1-01c0-4ebd-a6d8-7e2d2bbe3c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:54.944114 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06458c1-01c0-4ebd-a6d8-7e2d2bbe3c6e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:54.944404 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06458c1-01c0-4ebd-a6d8-7e2d2bbe3c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:54.944702 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06458c1-01c0-4ebd-a6d8-7e2d2bbe3c6e None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:54.949204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06458c1-01c0-4ebd-a6d8-7e2d2bbe3c6e None admin] RBAC: Authorizing `identity:get_project(project_id=7cf2243c0cdc44da93063ff4af6a2330)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:54.950751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06458c1-01c0-4ebd-a6d8-7e2d2bbe3c6e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:54.954525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 86/170] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:10:54 2022] GET /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330 => generated 299 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:54.957138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06458c1-01c0-4ebd-a6d8-7e2d2bbe3c6e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:55.126889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb6080-bd7a-4b74-b2ce-ee844cb61d18 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:55.142980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06458c1-01c0-4ebd-a6d8-7e2d2bbe3c6e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:55.183699 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061517d-f454-4976-8f69-2fde10945e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:55.185162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061517d-f454-4976-8f69-2fde10945e4f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:55.187053 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061517d-f454-4976-8f69-2fde10945e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:55.187529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061517d-f454-4976-8f69-2fde10945e4f None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:55.189984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061517d-f454-4976-8f69-2fde10945e4f None admin] RBAC: Authorizing `identity:get_project(project_id=7cf2243c0cdc44da93063ff4af6a2330)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:55.192364 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061517d-f454-4976-8f69-2fde10945e4f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:55.198061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 87/171] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:10:54 2022] GET /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330 => generated 299 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:55.199549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061517d-f454-4976-8f69-2fde10945e4f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:55.207439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135696e6-638e-4eed-90e7-79a89eb69ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:55.208395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135696e6-638e-4eed-90e7-79a89eb69ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:55.208910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135696e6-638e-4eed-90e7-79a89eb69ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:55.215001 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135696e6-638e-4eed-90e7-79a89eb69ad9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:55.306642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:55.337222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135696e6-638e-4eed-90e7-79a89eb69ad9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:55.339341 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135696e6-638e-4eed-90e7-79a89eb69ad9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:55.359494 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:55.412138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061517d-f454-4976-8f69-2fde10945e4f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:55.458124 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c57d2-f5f4-4e16-a196-0ae9b13d4158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:55.459937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c57d2-f5f4-4e16-a196-0ae9b13d4158 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:55.460420 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c57d2-f5f4-4e16-a196-0ae9b13d4158 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:55.461230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c57d2-f5f4-4e16-a196-0ae9b13d4158 None admin] PATH_INFO: `/v3/users/7dbee4330ce74aedb00eece717c969c5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:55.462223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 85/172] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:10:54 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:10:55.462851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c57d2-f5f4-4e16-a196-0ae9b13d4158 None admin] RBAC: Authorizing `identity:get_user(user_id=7dbee4330ce74aedb00eece717c969c5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:55.463242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135696e6-638e-4eed-90e7-79a89eb69ad9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:55.464805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c57d2-f5f4-4e16-a196-0ae9b13d4158 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:55.472777 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 88/173] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:55 2022] GET /identity/v3/users/7dbee4330ce74aedb00eece717c969c5 => generated 248 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:55.475933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c57d2-f5f4-4e16-a196-0ae9b13d4158 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:55.594486 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135696e6-638e-4eed-90e7-79a89eb69ad9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:55.605913 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c57d2-f5f4-4e16-a196-0ae9b13d4158 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:55.613703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:55.624951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:55.638392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d4fc7-a92e-40a1-8607-7804eed60d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:55.639656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d4fc7-a92e-40a1-8607-7804eed60d2d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:55.640315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d4fc7-a92e-40a1-8607-7804eed60d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:55.640758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d4fc7-a92e-40a1-8607-7804eed60d2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:55.641647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d4fc7-a92e-40a1-8607-7804eed60d2d None admin] RBAC: Adding query filter params (role.id=8801d305c8374d34abe896d3b7685174, scope.project.id=7cf2243c0cdc44da93063ff4af6a2330, user.id=42c3d6abafce4a929b4b6685de4943e5) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:55.642098 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d4fc7-a92e-40a1-8607-7804eed60d2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:55.643693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d4fc7-a92e-40a1-8607-7804eed60d2d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:55.643824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174b210-4734-4517-8c36-a305a7461910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:55.644477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174b210-4734-4517-8c36-a305a7461910 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:55.644785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174b210-4734-4517-8c36-a305a7461910 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:55.645061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174b210-4734-4517-8c36-a305a7461910 None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330/users/2eab0ecac24f459b83874b3f7a07599a/roles/3d0598848b8f4a18917b5dbb657caa63` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:55.647121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174b210-4734-4517-8c36-a305a7461910 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cf2243c0cdc44da93063ff4af6a2330, user_id=2eab0ecac24f459b83874b3f7a07599a, role_id=3d0598848b8f4a18917b5dbb657caa63)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:55.648576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174b210-4734-4517-8c36-a305a7461910 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:55.652324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 86/174] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:10:55 2022] GET /identity/v3/role_assignments?user.id=42c3d6abafce4a929b4b6685de4943e5&scope.project.id=7cf2243c0cdc44da93063ff4af6a2330&role.id=8801d305c8374d34abe896d3b7685174 => generated 610 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:55.654050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab2399-0c66-475d-9463-7580c043fa25 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:55.654587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab2399-0c66-475d-9463-7580c043fa25 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:55.655000 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab2399-0c66-475d-9463-7580c043fa25 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:55.656409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 87/175] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:55.657349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab2399-0c66-475d-9463-7580c043fa25 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:55.679866 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 89/176] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:10:55 2022] PUT /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330/users/2eab0ecac24f459b83874b3f7a07599a/roles/3d0598848b8f4a18917b5dbb657caa63 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:10:55.680975 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174b210-4734-4517-8c36-a305a7461910 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:55.787193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab2399-0c66-475d-9463-7580c043fa25 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:55.830320 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae184e4-6be3-42aa-b334-17611a8e9627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:55.831277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae184e4-6be3-42aa-b334-17611a8e9627 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:55.831710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae184e4-6be3-42aa-b334-17611a8e9627 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:55.832133 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae184e4-6be3-42aa-b334-17611a8e9627 None admin] PATH_INFO: `/v3/projects/b88f11b3ef5444f9b22ed43d4a86d7d3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:55.833614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae184e4-6be3-42aa-b334-17611a8e9627 None admin] RBAC: Authorizing `identity:get_project(project_id=b88f11b3ef5444f9b22ed43d4a86d7d3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:55.836157 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae184e4-6be3-42aa-b334-17611a8e9627 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:55.838235 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 88/177] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:10:55 2022] GET /identity/v3/projects/b88f11b3ef5444f9b22ed43d4a86d7d3 => generated 313 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:55.839699 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6163a-5d06-4f54-a3fb-a7a3053fb62a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:55.845302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6163a-5d06-4f54-a3fb-a7a3053fb62a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:55.845860 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6163a-5d06-4f54-a3fb-a7a3053fb62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:55.867396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-adc6163a-5d06-4f54-a3fb-a7a3053fb62a None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:55.868970 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-adc6163a-5d06-4f54-a3fb-a7a3053fb62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:55.913543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174b210-4734-4517-8c36-a305a7461910 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:55.923409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:55.954878 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 89/178] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:55.956626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e9980-9d42-4295-897c-5b9a04739177 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:55.957070 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e9980-9d42-4295-897c-5b9a04739177 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:55.957487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e9980-9d42-4295-897c-5b9a04739177 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:55.958972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 90/179] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:55.960462 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e9980-9d42-4295-897c-5b9a04739177 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:55.989648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a24f50-0acc-4586-85a0-ad76b9179ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:55.991405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a24f50-0acc-4586-85a0-ad76b9179ddc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:55.991925 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a24f50-0acc-4586-85a0-ad76b9179ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:55.992274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a24f50-0acc-4586-85a0-ad76b9179ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:56.066389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:56.095270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e9980-9d42-4295-897c-5b9a04739177 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:56.097822 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a24f50-0acc-4586-85a0-ad76b9179ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:56.103179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a24f50-0acc-4586-85a0-ad76b9179ddc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:56.141818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798035f2-13f1-436d-bed8-9303656aa0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:56.142473 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798035f2-13f1-436d-bed8-9303656aa0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:56.142710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798035f2-13f1-436d-bed8-9303656aa0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:56.142978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798035f2-13f1-436d-bed8-9303656aa0d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:56.143708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798035f2-13f1-436d-bed8-9303656aa0d2 None admin] RBAC: Adding query filter params (role.id=6be1975947cd4b948b86c73132244927, scope.project.id=b88f11b3ef5444f9b22ed43d4a86d7d3, user.id=42c3d6abafce4a929b4b6685de4943e5) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:56.144020 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798035f2-13f1-436d-bed8-9303656aa0d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:56.145989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798035f2-13f1-436d-bed8-9303656aa0d2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:56.153229 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 91/180] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:10:55 2022] GET /identity/v3/role_assignments?user.id=42c3d6abafce4a929b4b6685de4943e5&scope.project.id=b88f11b3ef5444f9b22ed43d4a86d7d3&role.id=6be1975947cd4b948b86c73132244927 => generated 610 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:56.154409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79755a-ab10-4405-a5ea-ad38dbb44154 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:56.154995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79755a-ab10-4405-a5ea-ad38dbb44154 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:56.154995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79755a-ab10-4405-a5ea-ad38dbb44154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:56.178126 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ee79755a-ab10-4405-a5ea-ad38dbb44154 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:56.179436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ee79755a-ab10-4405-a5ea-ad38dbb44154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:56.228675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:56.228869 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 90/181] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:10:55 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:10:56.230984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c63154-cd38-48a0-8c85-cb32a1af4e5e None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:56.231369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c63154-cd38-48a0-8c85-cb32a1af4e5e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:56.231758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c63154-cd38-48a0-8c85-cb32a1af4e5e None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:56.234061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 91/182] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:56 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:56.235788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c63154-cd38-48a0-8c85-cb32a1af4e5e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:56.267073 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 92/183] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:56.268855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ae936-5733-401e-8820-f97f80dc5120 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:56.269339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ae936-5733-401e-8820-f97f80dc5120 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:56.269957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ae936-5733-401e-8820-f97f80dc5120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:56.292071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-146ae936-5733-401e-8820-f97f80dc5120 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:56.293702 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-146ae936-5733-401e-8820-f97f80dc5120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:56.386209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:56.408201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 93/184] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:56.413849 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ae936-5733-401e-8820-f97f80dc5120 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:56.446189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c63154-cd38-48a0-8c85-cb32a1af4e5e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:56.542795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ae936-5733-401e-8820-f97f80dc5120 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:56.545658 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:56.557310 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e50e5-8324-4e29-8f7a-a35036ecaea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:56.557995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e50e5-8324-4e29-8f7a-a35036ecaea5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:56.558285 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e50e5-8324-4e29-8f7a-a35036ecaea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:56.558551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e50e5-8324-4e29-8f7a-a35036ecaea5 None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:56.559724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e50e5-8324-4e29-8f7a-a35036ecaea5 None admin] RBAC: Authorizing `identity:get_project(project_id=7cf2243c0cdc44da93063ff4af6a2330)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:56.561309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e50e5-8324-4e29-8f7a-a35036ecaea5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:56.565323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 92/185] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:10:56 2022] GET /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330 => generated 299 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:56.582656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e50e5-8324-4e29-8f7a-a35036ecaea5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:56.595692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03189aa-fadb-43e2-8a08-ca88d96761dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:56.596333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03189aa-fadb-43e2-8a08-ca88d96761dd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:56.596632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03189aa-fadb-43e2-8a08-ca88d96761dd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:56.596921 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03189aa-fadb-43e2-8a08-ca88d96761dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:56.625325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03189aa-fadb-43e2-8a08-ca88d96761dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:56.630847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f03189aa-fadb-43e2-8a08-ca88d96761dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:10:56.630847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:56.630847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:56.630847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:56.630847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:56.630847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:56.630847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:56.630847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:56.630847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:56.630847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:56.630847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:56.630847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:56.630847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:56.630847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:56.630847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:56.630847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:56.631785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:56.631785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:56.631785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:56.631785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:56.631785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:56.631785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:56.631785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:56.631785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:56.631785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:56.631785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:56.631785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:56.631785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:56.631785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:56.631785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:56.631785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:56.631785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:56.632733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:56.632733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:56.632733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:56.632733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:56.632733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:56.632733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:56.632733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:56.632733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:56.632733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:56.632733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:56.632733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:10:56.632733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:10:56.634154 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 94/186] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:10:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:56.634997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03189aa-fadb-43e2-8a08-ca88d96761dd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:56.720213 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e50e5-8324-4e29-8f7a-a35036ecaea5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:56.759904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416b9f8-9f91-4d16-8b9b-4a76d5248893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:56.760841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416b9f8-9f91-4d16-8b9b-4a76d5248893 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:56.761294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416b9f8-9f91-4d16-8b9b-4a76d5248893 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:56.761731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416b9f8-9f91-4d16-8b9b-4a76d5248893 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:56.762650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416b9f8-9f91-4d16-8b9b-4a76d5248893 None admin] RBAC: Adding query filter params (role.id=97ece22f2e264e0e857d5107325a85d9, scope.project.id=7cf2243c0cdc44da93063ff4af6a2330, user.id=7dbee4330ce74aedb00eece717c969c5) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:56.763189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416b9f8-9f91-4d16-8b9b-4a76d5248893 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:56.764890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416b9f8-9f91-4d16-8b9b-4a76d5248893 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:56.767116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03189aa-fadb-43e2-8a08-ca88d96761dd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:56.771531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 93/187] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:10:56 2022] GET /identity/v3/role_assignments?user.id=7dbee4330ce74aedb00eece717c969c5&scope.project.id=7cf2243c0cdc44da93063ff4af6a2330&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 610 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:56.772973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416b9f8-9f91-4d16-8b9b-4a76d5248893 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:56.796781 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:56.827549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36c7e6-19af-44ab-b047-9ef2c01ebd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:56.830316 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36c7e6-19af-44ab-b047-9ef2c01ebd01 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:56.831173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36c7e6-19af-44ab-b047-9ef2c01ebd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:56.831716 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36c7e6-19af-44ab-b047-9ef2c01ebd01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:56.848539 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36c7e6-19af-44ab-b047-9ef2c01ebd01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:56.855999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-6b36c7e6-19af-44ab-b047-9ef2c01ebd01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:10:56.855999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:56.855999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:56.855999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:56.855999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:56.855999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:56.855999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:56.855999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:56.855999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:56.855999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:56.855999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:56.855999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:56.855999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:56.855999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:56.855999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:56.855999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:56.857193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:56.857193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:56.857193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:56.857193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:56.857193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:56.857193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:56.857193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:56.857193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:56.857193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:56.857193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:56.857193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:56.857193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:56.857193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:56.857193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:56.857193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:56.857193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:56.858139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:56.858139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:56.858139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:56.858139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:56.858139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:56.858139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:56.858139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:56.858139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:56.858139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:56.858139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:56.858139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:10:56.858139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:10:56.861261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 95/188] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:10:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:56.861913 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36c7e6-19af-44ab-b047-9ef2c01ebd01 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:56.894942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:56.934518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416b9f8-9f91-4d16-8b9b-4a76d5248893 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:56.979740 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc75ca-a1b6-416f-be9d-1f72189bbfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:56.980450 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc75ca-a1b6-416f-be9d-1f72189bbfc4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:56.980761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc75ca-a1b6-416f-be9d-1f72189bbfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:56.981032 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc75ca-a1b6-416f-be9d-1f72189bbfc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:56.981717 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc75ca-a1b6-416f-be9d-1f72189bbfc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:56.982022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc75ca-a1b6-416f-be9d-1f72189bbfc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:56.983531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc75ca-a1b6-416f-be9d-1f72189bbfc4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:56.992330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36c7e6-19af-44ab-b047-9ef2c01ebd01 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:57.000950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 94/189] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:10:56 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:57.001822 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc75ca-a1b6-416f-be9d-1f72189bbfc4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:57.046386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13304f39-219a-415f-91fd-864dd7a61a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:57.047441 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13304f39-219a-415f-91fd-864dd7a61a91 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:57.047999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13304f39-219a-415f-91fd-864dd7a61a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:57.048280 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13304f39-219a-415f-91fd-864dd7a61a91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:57.049478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13304f39-219a-415f-91fd-864dd7a61a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:57.052009 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13304f39-219a-415f-91fd-864dd7a61a91 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:57.054272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 96/190] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:10:56 2022] GET /identity/v3/domains/default => generated 200 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:57.055136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13304f39-219a-415f-91fd-864dd7a61a91 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:57.091833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:57.125988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc75ca-a1b6-416f-be9d-1f72189bbfc4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:57.157420 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:57.162183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685bf95-7de6-47c8-a39e-82cda613b977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:57.163473 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685bf95-7de6-47c8-a39e-82cda613b977 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:57.163752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685bf95-7de6-47c8-a39e-82cda613b977 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:57.164019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685bf95-7de6-47c8-a39e-82cda613b977 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:57.164748 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685bf95-7de6-47c8-a39e-82cda613b977 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:57.165049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685bf95-7de6-47c8-a39e-82cda613b977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:57.166668 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685bf95-7de6-47c8-a39e-82cda613b977 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:57.168962 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13304f39-219a-415f-91fd-864dd7a61a91 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:57.175106 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 95/191] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:10:57 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:57.175893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685bf95-7de6-47c8-a39e-82cda613b977 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:57.207106 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837bdcf-588d-4f78-b20d-6794c3ac83c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:57.207735 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837bdcf-588d-4f78-b20d-6794c3ac83c2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:57.208005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837bdcf-588d-4f78-b20d-6794c3ac83c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:57.208271 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837bdcf-588d-4f78-b20d-6794c3ac83c2 None admin] PATH_INFO: `/v3/users/e0fdc16acc60474a8b631c28fe91edc9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:57.224619 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837bdcf-588d-4f78-b20d-6794c3ac83c2 None admin] RBAC: Authorizing `identity:get_user(user_id=e0fdc16acc60474a8b631c28fe91edc9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:57.226836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837bdcf-588d-4f78-b20d-6794c3ac83c2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:57.228479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 97/192] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:57 2022] GET /identity/v3/users/e0fdc16acc60474a8b631c28fe91edc9 => generated 284 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:57.233158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837bdcf-588d-4f78-b20d-6794c3ac83c2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:57.289500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685bf95-7de6-47c8-a39e-82cda613b977 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:57.327266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa28213-8ee4-4f04-ab21-81671d41a73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:57.327965 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa28213-8ee4-4f04-ab21-81671d41a73a None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:57.328242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa28213-8ee4-4f04-ab21-81671d41a73a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:57.328512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa28213-8ee4-4f04-ab21-81671d41a73a None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:57.329198 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa28213-8ee4-4f04-ab21-81671d41a73a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:57.330626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa28213-8ee4-4f04-ab21-81671d41a73a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:57.338824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:57.348147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837bdcf-588d-4f78-b20d-6794c3ac83c2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:57.355342 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 96/193] 10.222.0.107 () {60 vars in 1137 bytes} [Tue Aug 23 23:10:57 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:10:57.361768 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa28213-8ee4-4f04-ab21-81671d41a73a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:57.409455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffb77b-b2ae-4ec0-b270-342b7ee87e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:57.410492 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffb77b-b2ae-4ec0-b270-342b7ee87e42 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:57.410975 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffb77b-b2ae-4ec0-b270-342b7ee87e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:57.411476 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffb77b-b2ae-4ec0-b270-342b7ee87e42 None admin] PATH_INFO: `/v3/users/e0fdc16acc60474a8b631c28fe91edc9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:57.413600 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffb77b-b2ae-4ec0-b270-342b7ee87e42 None admin] RBAC: Authorizing `identity:get_user(user_id=e0fdc16acc60474a8b631c28fe91edc9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:57.416538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffb77b-b2ae-4ec0-b270-342b7ee87e42 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:57.419800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 98/194] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:57 2022] GET /identity/v3/users/e0fdc16acc60474a8b631c28fe91edc9 => generated 284 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:57.425839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffb77b-b2ae-4ec0-b270-342b7ee87e42 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:57.450404 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:57.499883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa28213-8ee4-4f04-ab21-81671d41a73a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:57.540874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd36488-7633-4513-b726-c518b1684cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:57.541784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd36488-7633-4513-b726-c518b1684cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:57.542217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd36488-7633-4513-b726-c518b1684cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:57.542495 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd36488-7633-4513-b726-c518b1684cf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:57.560512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffb77b-b2ae-4ec0-b270-342b7ee87e42 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:57.600395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc114a3-21e8-4424-b673-6af517650b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:57.601342 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc114a3-21e8-4424-b673-6af517650b90 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:57.601631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc114a3-21e8-4424-b673-6af517650b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:57.601901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc114a3-21e8-4424-b673-6af517650b90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:57.610589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:57.627151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd36488-7633-4513-b726-c518b1684cf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:57.628715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd36488-7633-4513-b726-c518b1684cf0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:57.701056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc114a3-21e8-4424-b673-6af517650b90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:57.703191 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc114a3-21e8-4424-b673-6af517650b90 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:57.726724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:57.763607 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 97/195] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:10:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:10:57.769500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd36488-7633-4513-b726-c518b1684cf0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:57.836444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 99/196] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:10:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:10:57.845807 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc114a3-21e8-4424-b673-6af517650b90 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:57.877841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:57.901709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd36488-7633-4513-b726-c518b1684cf0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:57.974393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc114a3-21e8-4424-b673-6af517650b90 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:57.982036 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c5912-6ca0-4398-89dd-28e75d9add38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:57.982935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c5912-6ca0-4398-89dd-28e75d9add38 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:57.983382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c5912-6ca0-4398-89dd-28e75d9add38 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:57.983794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c5912-6ca0-4398-89dd-28e75d9add38 None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:57.992631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c5912-6ca0-4398-89dd-28e75d9add38 None admin] RBAC: Authorizing `identity:get_project(project_id=c75a8d1aa0614b1aa01db2d404827c77)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:57.994799 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c5912-6ca0-4398-89dd-28e75d9add38 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:57.996938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 98/197] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:10:57 2022] GET /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77 => generated 303 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:10:58.001349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:58.005004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c5912-6ca0-4398-89dd-28e75d9add38 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:58.031110 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a76360-7785-45e4-be5e-0549d31140f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:58.031944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a76360-7785-45e4-be5e-0549d31140f8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:58.032267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a76360-7785-45e4-be5e-0549d31140f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:58.032689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a76360-7785-45e4-be5e-0549d31140f8 None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:58.034427 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a76360-7785-45e4-be5e-0549d31140f8 None admin] RBAC: Authorizing `identity:get_project(project_id=c75a8d1aa0614b1aa01db2d404827c77)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:58.035961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a76360-7785-45e4-be5e-0549d31140f8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:58.037692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 100/198] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:10:57 2022] GET /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77 => generated 303 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:58.042247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce7246-f595-48f7-86a0-3f52276e9e46 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:58.043005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce7246-f595-48f7-86a0-3f52276e9e46 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:58.043514 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce7246-f595-48f7-86a0-3f52276e9e46 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:58.045089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 101/199] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:10:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:10:58.045878 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce7246-f595-48f7-86a0-3f52276e9e46 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:58.143743 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c5912-6ca0-4398-89dd-28e75d9add38 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:58.164424 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce7246-f595-48f7-86a0-3f52276e9e46 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:58.183681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4c534-cc94-4b80-9211-31c3774c7dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:58.184282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4c534-cc94-4b80-9211-31c3774c7dae None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:58.184621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4c534-cc94-4b80-9211-31c3774c7dae None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:58.184913 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4c534-cc94-4b80-9211-31c3774c7dae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:58.185641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4c534-cc94-4b80-9211-31c3774c7dae None admin] RBAC: Adding query filter params (role.id=97ece22f2e264e0e857d5107325a85d9, scope.project.id=c75a8d1aa0614b1aa01db2d404827c77, user.id=e0fdc16acc60474a8b631c28fe91edc9) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:58.185946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4c534-cc94-4b80-9211-31c3774c7dae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:58.187381 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4c534-cc94-4b80-9211-31c3774c7dae None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:58.193348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 99/200] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:10:58 2022] GET /identity/v3/role_assignments?user.id=e0fdc16acc60474a8b631c28fe91edc9&scope.project.id=c75a8d1aa0614b1aa01db2d404827c77&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:10:58.195008 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc74a7-2c61-4b13-b71e-3052824e277b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:58.195403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc74a7-2c61-4b13-b71e-3052824e277b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:58.195773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc74a7-2c61-4b13-b71e-3052824e277b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:58.215198 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ffbc74a7-2c61-4b13-b71e-3052824e277b None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:58.216610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ffbc74a7-2c61-4b13-b71e-3052824e277b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:58.233391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da0770-918b-40af-8e9f-4c785c7e355d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:58.234019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da0770-918b-40af-8e9f-4c785c7e355d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:58.234293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da0770-918b-40af-8e9f-4c785c7e355d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:58.234560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da0770-918b-40af-8e9f-4c785c7e355d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:58.235302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da0770-918b-40af-8e9f-4c785c7e355d None admin] RBAC: Adding query filter params (role.id=8801d305c8374d34abe896d3b7685174, scope.project.id=c75a8d1aa0614b1aa01db2d404827c77, user.id=e0fdc16acc60474a8b631c28fe91edc9) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:58.235654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da0770-918b-40af-8e9f-4c785c7e355d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:58.237082 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da0770-918b-40af-8e9f-4c785c7e355d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:58.241677 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:58.254632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 102/201] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:10:58 2022] GET /identity/v3/role_assignments?user.id=e0fdc16acc60474a8b631c28fe91edc9&scope.project.id=c75a8d1aa0614b1aa01db2d404827c77&role.id=8801d305c8374d34abe896d3b7685174 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:58.322901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 100/202] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:10:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:10:58.655775 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da0770-918b-40af-8e9f-4c785c7e355d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:58.722165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:58.797534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da0770-918b-40af-8e9f-4c785c7e355d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:58.841768 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062f208-7fdb-40a4-9c36-593fbc02bb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:58.842435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062f208-7fdb-40a4-9c36-593fbc02bb19 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:58.842708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062f208-7fdb-40a4-9c36-593fbc02bb19 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:58.844843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062f208-7fdb-40a4-9c36-593fbc02bb19 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:58.862639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062f208-7fdb-40a4-9c36-593fbc02bb19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:58.868058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-0062f208-7fdb-40a4-9c36-593fbc02bb19 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:10:58.868058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:58.868058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:58.868058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:58.868058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:58.868058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:58.868058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:58.868058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:58.868058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:58.868058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:58.868058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:58.868058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:58.868058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:58.868058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:58.868058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:58.868058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:58.868988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:58.868988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:58.868988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:58.868988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:58.868988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:58.868988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:58.868988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:58.868988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:58.868988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:58.868988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:58.868988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:58.868988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:58.868988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:58.868988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:58.868988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:58.868988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:58.870681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:58.870681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:58.870681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:58.870681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:58.870681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:58.870681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:58.870681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:58.870681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:58.870681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:58.870681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:58.870681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:10:58.870681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:10:58.870681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 103/203] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:10:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:58.875025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc74a7-2c61-4b13-b71e-3052824e277b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:59.014177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc74a7-2c61-4b13-b71e-3052824e277b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:59.056643 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4574f-1315-4369-a654-dbf0e4f227de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:59.061077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4574f-1315-4369-a654-dbf0e4f227de None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:59.061364 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4574f-1315-4369-a654-dbf0e4f227de None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:59.061643 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4574f-1315-4369-a654-dbf0e4f227de None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:59.062354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4574f-1315-4369-a654-dbf0e4f227de None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:59.062658 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4574f-1315-4369-a654-dbf0e4f227de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:59.064131 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4574f-1315-4369-a654-dbf0e4f227de None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:59.077052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 101/204] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:10:58 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:59.082525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062f208-7fdb-40a4-9c36-593fbc02bb19 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:59.193077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062f208-7fdb-40a4-9c36-593fbc02bb19 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:59.217844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:59.238276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252228c-0927-4340-8845-2c3140b779fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:59.239241 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252228c-0927-4340-8845-2c3140b779fe None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:59.239711 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252228c-0927-4340-8845-2c3140b779fe None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:59.240170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252228c-0927-4340-8845-2c3140b779fe None admin] PATH_INFO: `/v3/users/2eab0ecac24f459b83874b3f7a07599a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:59.245261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252228c-0927-4340-8845-2c3140b779fe None admin] RBAC: Authorizing `identity:get_user(user_id=2eab0ecac24f459b83874b3f7a07599a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:59.246957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252228c-0927-4340-8845-2c3140b779fe None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:59.249090 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 104/205] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:10:59 2022] GET /identity/v3/users/2eab0ecac24f459b83874b3f7a07599a => generated 290 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:59.257762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4574f-1315-4369-a654-dbf0e4f227de None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:59.288161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:59.422922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4574f-1315-4369-a654-dbf0e4f227de None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:59.470562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4c114-e75d-4bec-a43f-ef7b4aeff5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:59.471177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4c114-e75d-4bec-a43f-ef7b4aeff5fd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:59.471451 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4c114-e75d-4bec-a43f-ef7b4aeff5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:59.471723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4c114-e75d-4bec-a43f-ef7b4aeff5fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:59.567610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4c114-e75d-4bec-a43f-ef7b4aeff5fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:59.569635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4c114-e75d-4bec-a43f-ef7b4aeff5fd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:59.590709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:59.710422 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 102/206] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:10:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:10:59.716378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252228c-0927-4340-8845-2c3140b779fe None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:59.892534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252228c-0927-4340-8845-2c3140b779fe None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:59.942029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d251d2-3752-43cc-b3f1-e676631bd9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:59.942677 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d251d2-3752-43cc-b3f1-e676631bd9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:59.942955 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d251d2-3752-43cc-b3f1-e676631bd9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:59.943221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d251d2-3752-43cc-b3f1-e676631bd9f1 None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:59.945037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d251d2-3752-43cc-b3f1-e676631bd9f1 None admin] RBAC: Authorizing `identity:get_project(project_id=7cf2243c0cdc44da93063ff4af6a2330)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:59.946491 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d251d2-3752-43cc-b3f1-e676631bd9f1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:59.952952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 105/207] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:10:59 2022] GET /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330 => generated 299 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:59.954357 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4c114-e75d-4bec-a43f-ef7b4aeff5fd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:00.005948 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961daa88-5651-4dcf-a3bd-bba58d997336 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:00.006874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961daa88-5651-4dcf-a3bd-bba58d997336 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:00.007249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961daa88-5651-4dcf-a3bd-bba58d997336 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:00.009240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 106/208] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:00.018059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9d067-b893-4672-9994-3e7533078a0f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:00.018338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9d067-b893-4672-9994-3e7533078a0f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:00.018610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9d067-b893-4672-9994-3e7533078a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:00.037338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a5e9d067-b893-4672-9994-3e7533078a0f None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:00.038880 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a5e9d067-b893-4672-9994-3e7533078a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:00.084800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:00.098660 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4c114-e75d-4bec-a43f-ef7b4aeff5fd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:00.116622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 107/209] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:00.116622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ff6fe-cbd5-44ee-935a-4b72667584d3 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:00.116622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ff6fe-cbd5-44ee-935a-4b72667584d3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:00.116622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ff6fe-cbd5-44ee-935a-4b72667584d3 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:00.116622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 108/210] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:00 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:00.127561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dd89e-9f13-4be6-ae37-c5ebfb487df2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:00.127837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dd89e-9f13-4be6-ae37-c5ebfb487df2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:00.128111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dd89e-9f13-4be6-ae37-c5ebfb487df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:00.145633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:00.151647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6ea0e-1422-4dac-8c81-88033a6ef305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:00.152516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ea0e-1422-4dac-8c81-88033a6ef305 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:00.153020 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ea0e-1422-4dac-8c81-88033a6ef305 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:00.153536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ea0e-1422-4dac-8c81-88033a6ef305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:00.154461 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6ea0e-1422-4dac-8c81-88033a6ef305 None admin] RBAC: Adding query filter params (role.id=3d0598848b8f4a18917b5dbb657caa63, scope.project.id=7cf2243c0cdc44da93063ff4af6a2330, user.id=2eab0ecac24f459b83874b3f7a07599a) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:00.154989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6ea0e-1422-4dac-8c81-88033a6ef305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:00.156663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6ea0e-1422-4dac-8c81-88033a6ef305 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:00.164196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 103/211] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:10:59 2022] GET /identity/v3/role_assignments?user.id=2eab0ecac24f459b83874b3f7a07599a&scope.project.id=7cf2243c0cdc44da93063ff4af6a2330&role.id=3d0598848b8f4a18917b5dbb657caa63 => generated 610 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:00.169977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ba5dd89e-9f13-4be6-ae37-c5ebfb487df2 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:00.169977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ba5dd89e-9f13-4be6-ae37-c5ebfb487df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:00.279326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 109/212] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:00.541524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89a42f-a09c-4eef-9175-cdfced6fdf1e None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:00.542523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89a42f-a09c-4eef-9175-cdfced6fdf1e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:00.542999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89a42f-a09c-4eef-9175-cdfced6fdf1e None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:00.544539 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 104/213] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:00.550452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5aed0-0128-4e58-9940-1fcb4c85086c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:00.550738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5aed0-0128-4e58-9940-1fcb4c85086c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:00.551017 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5aed0-0128-4e58-9940-1fcb4c85086c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:00.557326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89a42f-a09c-4eef-9175-cdfced6fdf1e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:00.576961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-dbf5aed0-0128-4e58-9940-1fcb4c85086c None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:00.578574 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-dbf5aed0-0128-4e58-9940-1fcb4c85086c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:00.663931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 110/214] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:00.664968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5aed0-0128-4e58-9940-1fcb4c85086c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:00.680317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89a42f-a09c-4eef-9175-cdfced6fdf1e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:00.715476 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:00.724687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a88b4-f509-4b40-8a80-47c7cdc6cabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:00.725738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a88b4-f509-4b40-8a80-47c7cdc6cabc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:00.726212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a88b4-f509-4b40-8a80-47c7cdc6cabc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:00.726782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a88b4-f509-4b40-8a80-47c7cdc6cabc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:00.728121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a88b4-f509-4b40-8a80-47c7cdc6cabc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:00.730256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a88b4-f509-4b40-8a80-47c7cdc6cabc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:00.736791 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 105/215] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:00 2022] GET /identity/v3/domains/default => generated 200 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:00.737909 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a88b4-f509-4b40-8a80-47c7cdc6cabc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:00.796933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:00.809993 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5aed0-0128-4e58-9940-1fcb4c85086c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:00.859585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753df56-0e40-412c-8619-1a0edd1b6587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:00.860486 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753df56-0e40-412c-8619-1a0edd1b6587 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:00.860816 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753df56-0e40-412c-8619-1a0edd1b6587 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:00.861087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753df56-0e40-412c-8619-1a0edd1b6587 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:00.874278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a88b4-f509-4b40-8a80-47c7cdc6cabc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:00.875135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753df56-0e40-412c-8619-1a0edd1b6587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:00.882713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-8753df56-0e40-412c-8619-1a0edd1b6587 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:00.882713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:00.882713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:00.882713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:00.882713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:00.882713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:00.882713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:00.882713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:00.882713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:00.882713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:00.882713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:00.882713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:00.882713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:00.882713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:00.882713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:00.882713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:00.883618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:00.883618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:00.883618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:00.883618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:00.883618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:00.883618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:00.883618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:00.883618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:00.883618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:00.883618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:00.883618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:00.883618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:00.883618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:00.883618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:00.883618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:00.883618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:00.884407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:00.884407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:00.884407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:00.884407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:00.884407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:00.884407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:00.884407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:00.884407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:00.884407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:00.884407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:00.884407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:00.884407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:00.884407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 111/216] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:00.887079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6a8c4-6221-4d6c-bda5-e98d24554947 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:00.887447 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6a8c4-6221-4d6c-bda5-e98d24554947 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:00.887797 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6a8c4-6221-4d6c-bda5-e98d24554947 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:00.889741 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 112/217] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:00 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:00.893408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6a8c4-6221-4d6c-bda5-e98d24554947 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:00.915115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2996f-c78c-484f-a73e-3349a31823cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:00.915990 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2996f-c78c-484f-a73e-3349a31823cc None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:00.916268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2996f-c78c-484f-a73e-3349a31823cc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:00.916538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2996f-c78c-484f-a73e-3349a31823cc None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:00.917259 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2996f-c78c-484f-a73e-3349a31823cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:00.918710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2996f-c78c-484f-a73e-3349a31823cc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:00.941621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 106/218] 10.222.0.107 () {60 vars in 1137 bytes} [Tue Aug 23 23:11:00 2022] POST /identity/v3/users => generated 298 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:11:00.942845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24cb38-1c97-4e15-9446-71e1cf1163da None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:00.943124 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24cb38-1c97-4e15-9446-71e1cf1163da None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:00.943397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24cb38-1c97-4e15-9446-71e1cf1163da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:00.964687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5a24cb38-1c97-4e15-9446-71e1cf1163da None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:00.965930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5a24cb38-1c97-4e15-9446-71e1cf1163da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:01.020475 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:01.030174 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6a8c4-6221-4d6c-bda5-e98d24554947 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:01.056840 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 107/219] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:01.057643 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24cb38-1c97-4e15-9446-71e1cf1163da None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:01.088190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae6393-a1f3-481a-99f4-9672475d5905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:01.089890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae6393-a1f3-481a-99f4-9672475d5905 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:01.090673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae6393-a1f3-481a-99f4-9672475d5905 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:01.091157 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae6393-a1f3-481a-99f4-9672475d5905 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:01.092042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae6393-a1f3-481a-99f4-9672475d5905 None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:01.092545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae6393-a1f3-481a-99f4-9672475d5905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:01.094969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae6393-a1f3-481a-99f4-9672475d5905 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:01.101743 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:01.108558 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 113/220] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:11:00 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:01.115572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae6393-a1f3-481a-99f4-9672475d5905 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:01.184885 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24cb38-1c97-4e15-9446-71e1cf1163da None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:01.232672 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d07e9a-71a6-405c-9b28-9c02d8c54361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:01.233432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d07e9a-71a6-405c-9b28-9c02d8c54361 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:01.233771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d07e9a-71a6-405c-9b28-9c02d8c54361 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:01.234045 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d07e9a-71a6-405c-9b28-9c02d8c54361 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:01.247717 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae6393-a1f3-481a-99f4-9672475d5905 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:01.249658 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d07e9a-71a6-405c-9b28-9c02d8c54361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:01.254469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-00d07e9a-71a6-405c-9b28-9c02d8c54361 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:01.254469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:01.254469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:01.254469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:01.254469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:01.254469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:01.254469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:01.254469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:01.254469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:01.254469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:01.254469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:01.254469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:01.254469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:01.254469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:01.254469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:01.254469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:01.255378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:01.255378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:01.255378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:01.255378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:01.255378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:01.255378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:01.255378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:01.255378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:01.255378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:01.255378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:01.255378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:01.255378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:01.255378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:01.255378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:01.255378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:01.255378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:01.256798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:01.256798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:01.256798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:01.256798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:01.256798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:01.256798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:01.256798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:01.256798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:01.256798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:01.256798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:01.256798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:01.256798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:01.256798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 108/221] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:11:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:01.262443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d07e9a-71a6-405c-9b28-9c02d8c54361 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:01.296989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dba906-f502-4f74-a5bf-359cf5f9ec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:01.298295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dba906-f502-4f74-a5bf-359cf5f9ec23 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:01.298778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dba906-f502-4f74-a5bf-359cf5f9ec23 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:01.299252 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dba906-f502-4f74-a5bf-359cf5f9ec23 None admin] PATH_INFO: `/v3/users/a4295442f0a24c02babd7372c9e6af08` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:01.315365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dba906-f502-4f74-a5bf-359cf5f9ec23 None admin] RBAC: Authorizing `identity:get_user(user_id=a4295442f0a24c02babd7372c9e6af08)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:01.316832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dba906-f502-4f74-a5bf-359cf5f9ec23 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:01.319194 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 114/222] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:11:01 2022] GET /identity/v3/users/a4295442f0a24c02babd7372c9e6af08 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:01.325519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dba906-f502-4f74-a5bf-359cf5f9ec23 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:01.348529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:01.386185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:01.393641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d07e9a-71a6-405c-9b28-9c02d8c54361 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:01.437322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca27a92-5c9a-40e5-beed-aabe44c450c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:01.437937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca27a92-5c9a-40e5-beed-aabe44c450c6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:01.438266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca27a92-5c9a-40e5-beed-aabe44c450c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:01.438540 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca27a92-5c9a-40e5-beed-aabe44c450c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:01.439215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca27a92-5c9a-40e5-beed-aabe44c450c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:01.439576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca27a92-5c9a-40e5-beed-aabe44c450c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:01.440990 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca27a92-5c9a-40e5-beed-aabe44c450c6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:01.454687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dba906-f502-4f74-a5bf-359cf5f9ec23 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:01.458410 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 109/223] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:01 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:01.461077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca27a92-5c9a-40e5-beed-aabe44c450c6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:01.497593 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b61f3a-551b-44a1-ab7e-a7f033a2b31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:01.498218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b61f3a-551b-44a1-ab7e-a7f033a2b31f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:01.498492 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b61f3a-551b-44a1-ab7e-a7f033a2b31f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:01.498760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b61f3a-551b-44a1-ab7e-a7f033a2b31f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:01.574471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b61f3a-551b-44a1-ab7e-a7f033a2b31f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:01.575871 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b61f3a-551b-44a1-ab7e-a7f033a2b31f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:01.583308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca27a92-5c9a-40e5-beed-aabe44c450c6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:01.594688 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:01.622338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f30bf-8fee-4730-97fd-18c5346299c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:01.623311 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f30bf-8fee-4730-97fd-18c5346299c0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:01.623805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f30bf-8fee-4730-97fd-18c5346299c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:01.624295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f30bf-8fee-4730-97fd-18c5346299c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:01.636318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f30bf-8fee-4730-97fd-18c5346299c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:01.642019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4d1f30bf-8fee-4730-97fd-18c5346299c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:01.642019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:01.642019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:01.642019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:01.642019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:01.642019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:01.642019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:01.642019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:01.642019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:01.642019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:01.642019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:01.642019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:01.642019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:01.642019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:01.642019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:01.642019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:01.642887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:01.642887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:01.642887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:01.642887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:01.642887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:01.642887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:01.642887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:01.642887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:01.642887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:01.642887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:01.642887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:01.642887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:01.642887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:01.642887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:01.642887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:01.642887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:01.643657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:01.643657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:01.643657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:01.643657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:01.643657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:01.643657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:01.643657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:01.643657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:01.643657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:01.643657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:01.643657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:01.643657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:01.645994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 110/224] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:11:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:01.647012 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f30bf-8fee-4730-97fd-18c5346299c0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:01.676999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:01.686458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 115/225] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:01 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:01.691970 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b61f3a-551b-44a1-ab7e-a7f033a2b31f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:01.754145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f30bf-8fee-4730-97fd-18c5346299c0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:01.789981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf85a3-332f-4906-8e7e-e5ee054f3d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:01.791227 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf85a3-332f-4906-8e7e-e5ee054f3d6d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:01.791755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf85a3-332f-4906-8e7e-e5ee054f3d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:01.792216 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf85a3-332f-4906-8e7e-e5ee054f3d6d None admin] PATH_INFO: `/v3/users/e0fdc16acc60474a8b631c28fe91edc9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:01.793666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf85a3-332f-4906-8e7e-e5ee054f3d6d None admin] RBAC: Authorizing `identity:get_user(user_id=e0fdc16acc60474a8b631c28fe91edc9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:01.795303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf85a3-332f-4906-8e7e-e5ee054f3d6d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:01.797183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 111/226] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:11:01 2022] GET /identity/v3/users/e0fdc16acc60474a8b631c28fe91edc9 => generated 284 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:01.801733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b61f3a-551b-44a1-ab7e-a7f033a2b31f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:01.802862 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf85a3-332f-4906-8e7e-e5ee054f3d6d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:01.821718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:01.842936 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be736071-a998-4088-8596-e031cb31dfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:01.843469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be736071-a998-4088-8596-e031cb31dfc3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:01.843742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be736071-a998-4088-8596-e031cb31dfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:01.844011 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be736071-a998-4088-8596-e031cb31dfc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:01.844704 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be736071-a998-4088-8596-e031cb31dfc3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:01.845005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be736071-a998-4088-8596-e031cb31dfc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:01.846372 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be736071-a998-4088-8596-e031cb31dfc3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:01.856349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 116/227] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:01 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:01.856937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be736071-a998-4088-8596-e031cb31dfc3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:01.914757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf85a3-332f-4906-8e7e-e5ee054f3d6d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:01.924971 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:01.952150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d3e05-fb63-450e-a4d9-395c9349cb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:01.953204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d3e05-fb63-450e-a4d9-395c9349cb6a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:01.953727 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d3e05-fb63-450e-a4d9-395c9349cb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:01.954193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d3e05-fb63-450e-a4d9-395c9349cb6a None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:01.955568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d3e05-fb63-450e-a4d9-395c9349cb6a None admin] RBAC: Authorizing `identity:get_project(project_id=c75a8d1aa0614b1aa01db2d404827c77)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:01.957252 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d3e05-fb63-450e-a4d9-395c9349cb6a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:01.959279 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 112/228] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:01 2022] GET /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77 => generated 303 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:01.960789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d3e05-fb63-450e-a4d9-395c9349cb6a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:01.970856 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be736071-a998-4088-8596-e031cb31dfc3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:02.008753 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dfa1b-6b7a-40b9-b320-64a0978d335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:02.009540 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dfa1b-6b7a-40b9-b320-64a0978d335c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:02.009826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dfa1b-6b7a-40b9-b320-64a0978d335c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:02.010093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dfa1b-6b7a-40b9-b320-64a0978d335c None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:02.011230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501dfa1b-6b7a-40b9-b320-64a0978d335c None admin] RBAC: Authorizing `identity:get_project(project_id=c75a8d1aa0614b1aa01db2d404827c77)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:02.012700 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501dfa1b-6b7a-40b9-b320-64a0978d335c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:02.014486 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 117/229] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:01 2022] GET /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77 => generated 303 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:02.015166 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dfa1b-6b7a-40b9-b320-64a0978d335c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:02.071442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:02.079916 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d3e05-fb63-450e-a4d9-395c9349cb6a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:02.115988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb8a14-6ae7-45a1-98bb-7d5c04a8d751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:02.116719 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb8a14-6ae7-45a1-98bb-7d5c04a8d751 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:02.117094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb8a14-6ae7-45a1-98bb-7d5c04a8d751 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:02.117466 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb8a14-6ae7-45a1-98bb-7d5c04a8d751 None admin] PATH_INFO: `/v3/users/e0fdc16acc60474a8b631c28fe91edc9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:02.118721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb8a14-6ae7-45a1-98bb-7d5c04a8d751 None admin] RBAC: Authorizing `identity:get_user(user_id=e0fdc16acc60474a8b631c28fe91edc9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:02.120285 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb8a14-6ae7-45a1-98bb-7d5c04a8d751 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:02.122401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 113/230] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:11:01 2022] GET /identity/v3/users/e0fdc16acc60474a8b631c28fe91edc9 => generated 284 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:02.123170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb8a14-6ae7-45a1-98bb-7d5c04a8d751 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:02.135294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dfa1b-6b7a-40b9-b320-64a0978d335c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:02.147904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:02.174805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869d119-8cb6-4b55-b1fc-d1ee0306e7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:02.175652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869d119-8cb6-4b55-b1fc-d1ee0306e7fa None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:02.176068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869d119-8cb6-4b55-b1fc-d1ee0306e7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:02.176474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869d119-8cb6-4b55-b1fc-d1ee0306e7fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:02.177491 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869d119-8cb6-4b55-b1fc-d1ee0306e7fa None admin] RBAC: Adding query filter params (role.id=6be1975947cd4b948b86c73132244927, scope.project.id=c75a8d1aa0614b1aa01db2d404827c77, user.id=a4295442f0a24c02babd7372c9e6af08) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:02.178590 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869d119-8cb6-4b55-b1fc-d1ee0306e7fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:02.180821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869d119-8cb6-4b55-b1fc-d1ee0306e7fa None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:02.187615 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 118/231] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:11:02 2022] GET /identity/v3/role_assignments?user.id=a4295442f0a24c02babd7372c9e6af08&scope.project.id=c75a8d1aa0614b1aa01db2d404827c77&role.id=6be1975947cd4b948b86c73132244927 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:02.194621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869d119-8cb6-4b55-b1fc-d1ee0306e7fa None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:02.247429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb8a14-6ae7-45a1-98bb-7d5c04a8d751 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:02.292693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf86ab-97c4-46a2-a79b-9a2f9080ea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:02.293525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf86ab-97c4-46a2-a79b-9a2f9080ea4f None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:02.293949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf86ab-97c4-46a2-a79b-9a2f9080ea4f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:02.294759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf86ab-97c4-46a2-a79b-9a2f9080ea4f None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77/users/e0fdc16acc60474a8b631c28fe91edc9/roles/97ece22f2e264e0e857d5107325a85d9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:02.297035 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf86ab-97c4-46a2-a79b-9a2f9080ea4f None admin] RBAC: Authorizing `identity:create_grant(project_id=c75a8d1aa0614b1aa01db2d404827c77, user_id=e0fdc16acc60474a8b631c28fe91edc9, role_id=97ece22f2e264e0e857d5107325a85d9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:02.298801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf86ab-97c4-46a2-a79b-9a2f9080ea4f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:02.318107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 114/232] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:11:02 2022] PUT /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77/users/e0fdc16acc60474a8b631c28fe91edc9/roles/97ece22f2e264e0e857d5107325a85d9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:02.392823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869d119-8cb6-4b55-b1fc-d1ee0306e7fa None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:02.413865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:02.453856 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9257ad-7a7f-4c9b-a4f0-706c06923c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:02.454519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9257ad-7a7f-4c9b-a4f0-706c06923c6c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:02.454801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9257ad-7a7f-4c9b-a4f0-706c06923c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:02.455074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9257ad-7a7f-4c9b-a4f0-706c06923c6c None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:02.456302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9257ad-7a7f-4c9b-a4f0-706c06923c6c None admin] RBAC: Authorizing `identity:get_project(project_id=c75a8d1aa0614b1aa01db2d404827c77)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:02.457864 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9257ad-7a7f-4c9b-a4f0-706c06923c6c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:02.460284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 119/233] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:02 2022] GET /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77 => generated 303 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:02.466608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf86ab-97c4-46a2-a79b-9a2f9080ea4f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:02.578120 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:02.609969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf86ab-97c4-46a2-a79b-9a2f9080ea4f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:02.655744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0fddb-943e-4183-b428-3a5e639df75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:02.656338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0fddb-943e-4183-b428-3a5e639df75b None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:02.656639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0fddb-943e-4183-b428-3a5e639df75b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:02.656919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0fddb-943e-4183-b428-3a5e639df75b None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77/users/e0fdc16acc60474a8b631c28fe91edc9/roles/8801d305c8374d34abe896d3b7685174` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:02.659209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0fddb-943e-4183-b428-3a5e639df75b None admin] RBAC: Authorizing `identity:create_grant(project_id=c75a8d1aa0614b1aa01db2d404827c77, user_id=e0fdc16acc60474a8b631c28fe91edc9, role_id=8801d305c8374d34abe896d3b7685174)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:02.660802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0fddb-943e-4183-b428-3a5e639df75b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:02.685715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 115/234] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:11:02 2022] PUT /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77/users/e0fdc16acc60474a8b631c28fe91edc9/roles/8801d305c8374d34abe896d3b7685174 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:03.315635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82796d-1d72-42d6-8480-95bfb744b21b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:03.316070 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82796d-1d72-42d6-8480-95bfb744b21b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:03.316458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82796d-1d72-42d6-8480-95bfb744b21b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:03.318190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 120/235] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:03.324291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d137343-b2ee-4d60-a649-64a5ceda9781 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:03.324581 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d137343-b2ee-4d60-a649-64a5ceda9781 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:03.324888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d137343-b2ee-4d60-a649-64a5ceda9781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:03.353613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2d137343-b2ee-4d60-a649-64a5ceda9781 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:03.354904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2d137343-b2ee-4d60-a649-64a5ceda9781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:03.432175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 116/236] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:03.546131 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15f08b-c6de-4165-afeb-9fabcaf2b82a None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:03.546641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15f08b-c6de-4165-afeb-9fabcaf2b82a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:03.546641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15f08b-c6de-4165-afeb-9fabcaf2b82a None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:03.548259 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 121/237] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:03.554548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4e72-499d-4e01-a02c-4f7f42ff6f37 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:03.554832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4e72-499d-4e01-a02c-4f7f42ff6f37 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:03.555102 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4e72-499d-4e01-a02c-4f7f42ff6f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:03.573036 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-181f4e72-499d-4e01-a02c-4f7f42ff6f37 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:03.574147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-181f4e72-499d-4e01-a02c-4f7f42ff6f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:03.666326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:03.672068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 117/238] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:03.785780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15f08b-c6de-4165-afeb-9fabcaf2b82a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:03.908437 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15f08b-c6de-4165-afeb-9fabcaf2b82a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:03.951101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdbe28-8dd5-4ac7-9600-84b66e5f1fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:03.952102 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdbe28-8dd5-4ac7-9600-84b66e5f1fac None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:03.952571 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdbe28-8dd5-4ac7-9600-84b66e5f1fac None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:03.953068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdbe28-8dd5-4ac7-9600-84b66e5f1fac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:03.963816 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdbe28-8dd5-4ac7-9600-84b66e5f1fac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:03.969192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-1ccdbe28-8dd5-4ac7-9600-84b66e5f1fac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:11:03.969192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:03.969192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:03.969192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:03.969192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:03.969192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:03.969192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:03.969192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:03.969192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:03.969192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:03.969192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:03.969192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:03.969192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:03.969192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:03.969192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:03.969192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:03.970052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:03.970052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:03.970052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:03.970052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:03.970052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:03.970052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:03.970052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:03.970052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:03.970052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:03.970052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:03.970052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:03.970052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:03.970052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:03.970052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:03.970052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:03.970052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:03.970833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:03.970833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:03.970833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:03.970833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:03.970833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:03.970833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:03.970833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:03.970833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:03.970833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:03.970833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:03.970833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:11:03.970833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:03.973397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 122/239] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:03.980641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f4e72-499d-4e01-a02c-4f7f42ff6f37 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:04.001083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdbe28-8dd5-4ac7-9600-84b66e5f1fac None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:04.061042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:04.182115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f4e72-499d-4e01-a02c-4f7f42ff6f37 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:04.182438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdbe28-8dd5-4ac7-9600-84b66e5f1fac None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:04.233598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e7172-0d9b-484f-8c69-ac152670ba8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:04.234255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e7172-0d9b-484f-8c69-ac152670ba8d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:04.234534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e7172-0d9b-484f-8c69-ac152670ba8d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:04.234805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e7172-0d9b-484f-8c69-ac152670ba8d None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:04.235527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e7172-0d9b-484f-8c69-ac152670ba8d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:04.235831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e7172-0d9b-484f-8c69-ac152670ba8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:04.237253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e7172-0d9b-484f-8c69-ac152670ba8d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:04.246264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefeb1f-3672-4f32-b102-ce2a68b8332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:04.246921 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefeb1f-3672-4f32-b102-ce2a68b8332b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:04.247199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefeb1f-3672-4f32-b102-ce2a68b8332b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:04.247472 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefeb1f-3672-4f32-b102-ce2a68b8332b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:04.247572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 118/240] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:11:03 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:04.253348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefeb1f-3672-4f32-b102-ce2a68b8332b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:04.253603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e7172-0d9b-484f-8c69-ac152670ba8d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:04.254834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefeb1f-3672-4f32-b102-ce2a68b8332b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:04.257339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 123/241] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:04 2022] GET /identity/v3/domains/default => generated 200 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:04.262653 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefeb1f-3672-4f32-b102-ce2a68b8332b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:04.328023 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:04.402303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e7172-0d9b-484f-8c69-ac152670ba8d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:04.441433 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf454c-4f87-4e51-860d-9d932f2b51d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:04.442408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf454c-4f87-4e51-860d-9d932f2b51d0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:04.443994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf454c-4f87-4e51-860d-9d932f2b51d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:04.445718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf454c-4f87-4e51-860d-9d932f2b51d0 None admin] PATH_INFO: `/v3/users/d98c5e918de34d4baa05adb432345aa6` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:04.470298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf454c-4f87-4e51-860d-9d932f2b51d0 None admin] RBAC: Authorizing `identity:get_user(user_id=d98c5e918de34d4baa05adb432345aa6)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:04.472224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf454c-4f87-4e51-860d-9d932f2b51d0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:04.475761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 119/242] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:11:04 2022] GET /identity/v3/users/d98c5e918de34d4baa05adb432345aa6 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:04.479895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefeb1f-3672-4f32-b102-ce2a68b8332b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:04.482715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf454c-4f87-4e51-860d-9d932f2b51d0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:04.488922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:04.536952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c866662-4be8-40a8-92a0-350041b90acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:04.538431 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c866662-4be8-40a8-92a0-350041b90acf None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:04.538715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c866662-4be8-40a8-92a0-350041b90acf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:04.542953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c866662-4be8-40a8-92a0-350041b90acf None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:04.543627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c866662-4be8-40a8-92a0-350041b90acf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:04.546404 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c866662-4be8-40a8-92a0-350041b90acf None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:04.586854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 124/243] 10.222.0.107 () {60 vars in 1137 bytes} [Tue Aug 23 23:11:04 2022] POST /identity/v3/users => generated 294 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:11:04.635759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87471d1-7bd7-446b-bb39-73130db769e9 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:04.636072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87471d1-7bd7-446b-bb39-73130db769e9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:04.636310 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87471d1-7bd7-446b-bb39-73130db769e9 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:04.638118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 125/244] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:11:04.651534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97934007-d4d6-4a1b-a63e-ad480eb46d54 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:04.651945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97934007-d4d6-4a1b-a63e-ad480eb46d54 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:04.652222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97934007-d4d6-4a1b-a63e-ad480eb46d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:04.679651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf454c-4f87-4e51-860d-9d932f2b51d0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:04.689898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-97934007-d4d6-4a1b-a63e-ad480eb46d54 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:04.691143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-97934007-d4d6-4a1b-a63e-ad480eb46d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:04.704050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:04.733355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e506f2-200d-44e0-96ed-70a0ce6a7e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:04.734285 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e506f2-200d-44e0-96ed-70a0ce6a7e24 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:04.736393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e506f2-200d-44e0-96ed-70a0ce6a7e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:04.736916 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e506f2-200d-44e0-96ed-70a0ce6a7e24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:04.832628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 126/245] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:04.832628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444b749-285a-4f53-bac8-c9a2d95e06a6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:04.832628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444b749-285a-4f53-bac8-c9a2d95e06a6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:04.832628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444b749-285a-4f53-bac8-c9a2d95e06a6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:04.838329 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 127/246] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:04.839931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99876c4f-f8ee-4cfe-9100-616127d9b2b9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:04.840211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99876c4f-f8ee-4cfe-9100-616127d9b2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:04.840478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99876c4f-f8ee-4cfe-9100-616127d9b2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:04.855195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e506f2-200d-44e0-96ed-70a0ce6a7e24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:04.857749 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e506f2-200d-44e0-96ed-70a0ce6a7e24 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:04.860531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-99876c4f-f8ee-4cfe-9100-616127d9b2b9 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:04.861731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-99876c4f-f8ee-4cfe-9100-616127d9b2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:04.955490 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 128/247] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:05.024327 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 120/248] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:04 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:05.032097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99876c4f-f8ee-4cfe-9100-616127d9b2b9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:05.059474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:05.168073 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e506f2-200d-44e0-96ed-70a0ce6a7e24 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:05.172423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99876c4f-f8ee-4cfe-9100-616127d9b2b9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:05.192456 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:05.212629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1aaea0-477b-4fb2-8be2-639207d90323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:05.212815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1aaea0-477b-4fb2-8be2-639207d90323 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:05.213024 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1aaea0-477b-4fb2-8be2-639207d90323 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:05.213291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1aaea0-477b-4fb2-8be2-639207d90323 None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:05.214483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1aaea0-477b-4fb2-8be2-639207d90323 None admin] RBAC: Authorizing `identity:get_project(project_id=c75a8d1aa0614b1aa01db2d404827c77)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:05.216014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1aaea0-477b-4fb2-8be2-639207d90323 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:05.221690 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 129/249] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:05 2022] GET /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77 => generated 303 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:05.224418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1aaea0-477b-4fb2-8be2-639207d90323 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:05.292921 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e506f2-200d-44e0-96ed-70a0ce6a7e24 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:05.329501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:05.342864 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa58df0-ed60-479d-b8e1-e90eeaf0ed1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:05.343516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa58df0-ed60-479d-b8e1-e90eeaf0ed1d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:05.343795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa58df0-ed60-479d-b8e1-e90eeaf0ed1d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:05.344069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa58df0-ed60-479d-b8e1-e90eeaf0ed1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:05.344422 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1aaea0-477b-4fb2-8be2-639207d90323 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:05.359123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa58df0-ed60-479d-b8e1-e90eeaf0ed1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:05.366510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-efa58df0-ed60-479d-b8e1-e90eeaf0ed1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:05.366510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:05.366510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:05.366510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:05.366510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:05.366510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:05.366510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:05.366510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:05.366510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:05.366510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:05.366510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:05.366510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:05.366510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:05.366510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:05.366510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:05.366510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:05.367439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:05.367439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:05.367439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:05.367439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:05.367439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:05.367439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:05.367439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:05.367439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:05.367439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:05.367439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:05.367439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:05.367439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:05.367439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:05.367439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:05.367439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:05.367439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:05.368247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:05.368247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:05.368247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:05.368247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:05.368247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:05.368247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:05.368247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:05.368247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:05.368247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:05.368247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:05.368247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:05.368247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:05.375304 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 121/250] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:11:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:11:05.375304 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa58df0-ed60-479d-b8e1-e90eeaf0ed1d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:05.393544 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaec922-e1fd-4527-9208-54f437e423ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:05.394310 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaec922-e1fd-4527-9208-54f437e423ca None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:05.394681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaec922-e1fd-4527-9208-54f437e423ca None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:05.395043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaec922-e1fd-4527-9208-54f437e423ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:05.395885 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaec922-e1fd-4527-9208-54f437e423ca None admin] RBAC: Adding query filter params (role.id=3d0598848b8f4a18917b5dbb657caa63, scope.project.id=c75a8d1aa0614b1aa01db2d404827c77, user.id=d98c5e918de34d4baa05adb432345aa6) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:05.396295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaec922-e1fd-4527-9208-54f437e423ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:05.398508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaec922-e1fd-4527-9208-54f437e423ca None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:05.407655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 130/251] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:11:05 2022] GET /identity/v3/role_assignments?user.id=d98c5e918de34d4baa05adb432345aa6&scope.project.id=c75a8d1aa0614b1aa01db2d404827c77&role.id=3d0598848b8f4a18917b5dbb657caa63 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:05.407655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d684ed-83e5-4316-88d7-abca5f721fbb None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:05.407655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d684ed-83e5-4316-88d7-abca5f721fbb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:05.407655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d684ed-83e5-4316-88d7-abca5f721fbb None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:05.408072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 131/252] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:05 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:05.408891 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d684ed-83e5-4316-88d7-abca5f721fbb None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:05.520061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:05.569630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa58df0-ed60-479d-b8e1-e90eeaf0ed1d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:05.614065 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d684ed-83e5-4316-88d7-abca5f721fbb None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:05.628847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459f803-37cc-4af5-b09b-45ee8a90cc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:05.629492 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459f803-37cc-4af5-b09b-45ee8a90cc2b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:05.629773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459f803-37cc-4af5-b09b-45ee8a90cc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:05.630047 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459f803-37cc-4af5-b09b-45ee8a90cc2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:05.642731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459f803-37cc-4af5-b09b-45ee8a90cc2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:05.648721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-0459f803-37cc-4af5-b09b-45ee8a90cc2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:05.648721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:05.648721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:05.648721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:05.648721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:05.648721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:05.648721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:05.648721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:05.648721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:05.648721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:05.648721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:05.648721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:05.648721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:05.648721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:05.648721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:05.648721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:05.649656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:05.649656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:05.649656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:05.649656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:05.649656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:05.649656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:05.649656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:05.649656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:05.649656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:05.649656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:05.649656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:05.649656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:05.649656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:05.649656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:05.649656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:05.649656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:05.650518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:05.650518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:05.650518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:05.650518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:05.650518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:05.650518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:05.650518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:05.650518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:05.650518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:05.650518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:05.650518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:05.650518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:05.650518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 122/253] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:05.651179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db727606-1eae-4e4c-8d17-0302c48dbbbd None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:05.651751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db727606-1eae-4e4c-8d17-0302c48dbbbd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:05.651751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db727606-1eae-4e4c-8d17-0302c48dbbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:05.675512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-db727606-1eae-4e4c-8d17-0302c48dbbbd None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:05.676757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-db727606-1eae-4e4c-8d17-0302c48dbbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:05.704045 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75c9c5-4b1f-4e75-88f8-c77945385752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:05.705917 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75c9c5-4b1f-4e75-88f8-c77945385752 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:05.706201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75c9c5-4b1f-4e75-88f8-c77945385752 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:05.706474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75c9c5-4b1f-4e75-88f8-c77945385752 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:05.707161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75c9c5-4b1f-4e75-88f8-c77945385752 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:05.707468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75c9c5-4b1f-4e75-88f8-c77945385752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:05.709318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75c9c5-4b1f-4e75-88f8-c77945385752 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:05.734448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 132/254] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:05 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:05.735414 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75c9c5-4b1f-4e75-88f8-c77945385752 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:05.782747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:05.785068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 123/255] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:05.786516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db727606-1eae-4e4c-8d17-0302c48dbbbd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:05.863575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:05.904429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db727606-1eae-4e4c-8d17-0302c48dbbbd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:05.942631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22efdbb-d2b9-49a5-8fc6-5ca5a3c26dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:05.943270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22efdbb-d2b9-49a5-8fc6-5ca5a3c26dde None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:05.943689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22efdbb-d2b9-49a5-8fc6-5ca5a3c26dde None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:05.944007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22efdbb-d2b9-49a5-8fc6-5ca5a3c26dde None admin] PATH_INFO: `/v3/users/e0fdc16acc60474a8b631c28fe91edc9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:05.945703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22efdbb-d2b9-49a5-8fc6-5ca5a3c26dde None admin] RBAC: Authorizing `identity:get_user(user_id=e0fdc16acc60474a8b631c28fe91edc9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:05.947148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22efdbb-d2b9-49a5-8fc6-5ca5a3c26dde None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:05.949439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 124/256] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:11:05 2022] GET /identity/v3/users/e0fdc16acc60474a8b631c28fe91edc9 => generated 284 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:05.954787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22efdbb-d2b9-49a5-8fc6-5ca5a3c26dde None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:06.020778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75c9c5-4b1f-4e75-88f8-c77945385752 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:06.118196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe1766-bfc9-46d1-a9ff-786850c7bec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:06.119642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe1766-bfc9-46d1-a9ff-786850c7bec4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:06.120195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe1766-bfc9-46d1-a9ff-786850c7bec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:06.121179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe1766-bfc9-46d1-a9ff-786850c7bec4 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:06.122137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe1766-bfc9-46d1-a9ff-786850c7bec4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:06.124720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe1766-bfc9-46d1-a9ff-786850c7bec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:06.126246 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe1766-bfc9-46d1-a9ff-786850c7bec4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:06.144367 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 133/257] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:11:05 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:06.150292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe1766-bfc9-46d1-a9ff-786850c7bec4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:06.198331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22efdbb-d2b9-49a5-8fc6-5ca5a3c26dde None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:06.264698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaad0ea-2dcd-4742-ad68-93dfeda78216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:06.266293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaad0ea-2dcd-4742-ad68-93dfeda78216 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:06.267465 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaad0ea-2dcd-4742-ad68-93dfeda78216 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:06.268052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaad0ea-2dcd-4742-ad68-93dfeda78216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:06.276958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:06.304973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:06.317195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe1766-bfc9-46d1-a9ff-786850c7bec4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:06.352578 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6296d6f-98b1-47e0-972c-a2c7d1c1a00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:06.353241 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6296d6f-98b1-47e0-972c-a2c7d1c1a00c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:06.353520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6296d6f-98b1-47e0-972c-a2c7d1c1a00c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:06.353791 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6296d6f-98b1-47e0-972c-a2c7d1c1a00c None admin] PATH_INFO: `/v3/users/a4295442f0a24c02babd7372c9e6af08` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:06.354933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6296d6f-98b1-47e0-972c-a2c7d1c1a00c None admin] RBAC: Authorizing `identity:get_user(user_id=a4295442f0a24c02babd7372c9e6af08)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:06.356400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6296d6f-98b1-47e0-972c-a2c7d1c1a00c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:06.358351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 134/258] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:11:06 2022] GET /identity/v3/users/a4295442f0a24c02babd7372c9e6af08 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:06.359154 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6296d6f-98b1-47e0-972c-a2c7d1c1a00c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:06.391938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaad0ea-2dcd-4742-ad68-93dfeda78216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:06.398882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaad0ea-2dcd-4742-ad68-93dfeda78216 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:06.465490 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6296d6f-98b1-47e0-972c-a2c7d1c1a00c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:06.502222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c61bff-3dc8-44dd-a933-17d766e87a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:06.502868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c61bff-3dc8-44dd-a933-17d766e87a72 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:06.503147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c61bff-3dc8-44dd-a933-17d766e87a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:06.503422 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c61bff-3dc8-44dd-a933-17d766e87a72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:06.515318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c61bff-3dc8-44dd-a933-17d766e87a72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:06.522031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-13c61bff-3dc8-44dd-a933-17d766e87a72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:06.522031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:06.522031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:06.522031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:06.522031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:06.522031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:06.522031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:06.522031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:06.522031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:06.522031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:06.522031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:06.522031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:06.522031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:06.522031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:06.522031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:06.522031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:06.523104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:06.523104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:06.523104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:06.523104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:06.523104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:06.523104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:06.523104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:06.523104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:06.523104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:06.523104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:06.523104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:06.523104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:06.523104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:06.523104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:06.523104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:06.523104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:06.523982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:06.523982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:06.523982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:06.523982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:06.523982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:06.523982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:06.523982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:06.523982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:06.523982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:06.523982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:06.523982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:06.523982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:06.523982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 135/259] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:11:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:06.524661 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c61bff-3dc8-44dd-a933-17d766e87a72 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:06.546239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:06.637148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 125/260] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:05 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:11:06.638074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaad0ea-2dcd-4742-ad68-93dfeda78216 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:06.679445 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:06.746282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c61bff-3dc8-44dd-a933-17d766e87a72 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:06.766568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaad0ea-2dcd-4742-ad68-93dfeda78216 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:06.809887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768c6d5-eca4-4407-9dda-ccff976e28e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:06.811365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768c6d5-eca4-4407-9dda-ccff976e28e2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:06.811645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768c6d5-eca4-4407-9dda-ccff976e28e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:06.811912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768c6d5-eca4-4407-9dda-ccff976e28e2 None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:06.813659 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768c6d5-eca4-4407-9dda-ccff976e28e2 None admin] RBAC: Authorizing `identity:get_project(project_id=c75a8d1aa0614b1aa01db2d404827c77)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:06.815124 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768c6d5-eca4-4407-9dda-ccff976e28e2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:06.819143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 136/261] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:06 2022] GET /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77 => generated 303 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:06.820624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768c6d5-eca4-4407-9dda-ccff976e28e2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:06.836322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fc70e-d649-43ed-9a79-5384d7601752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:06.836983 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fc70e-d649-43ed-9a79-5384d7601752 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:06.837230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fc70e-d649-43ed-9a79-5384d7601752 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:06.837503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fc70e-d649-43ed-9a79-5384d7601752 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:06.838174 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fc70e-d649-43ed-9a79-5384d7601752 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:06.838478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fc70e-d649-43ed-9a79-5384d7601752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:06.839851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fc70e-d649-43ed-9a79-5384d7601752 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:06.857441 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 126/262] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:06 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:06.858284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fc70e-d649-43ed-9a79-5384d7601752 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:06.939998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:06.971535 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768c6d5-eca4-4407-9dda-ccff976e28e2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:07.017429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e79c2-27e7-4fa0-b4c1-735f93aac9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:07.018429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e79c2-27e7-4fa0-b4c1-735f93aac9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:07.018938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e79c2-27e7-4fa0-b4c1-735f93aac9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:07.019406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e79c2-27e7-4fa0-b4c1-735f93aac9a9 None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:07.020838 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e79c2-27e7-4fa0-b4c1-735f93aac9a9 None admin] RBAC: Authorizing `identity:get_project(project_id=c75a8d1aa0614b1aa01db2d404827c77)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:07.023493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e79c2-27e7-4fa0-b4c1-735f93aac9a9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:07.027609 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 137/263] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:06 2022] GET /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77 => generated 303 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:07.030115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e79c2-27e7-4fa0-b4c1-735f93aac9a9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:07.072083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:07.080684 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fc70e-d649-43ed-9a79-5384d7601752 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:07.144053 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458d5ff-4abd-4130-9b57-1b0345f8885b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:07.144783 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458d5ff-4abd-4130-9b57-1b0345f8885b None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:07.145108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458d5ff-4abd-4130-9b57-1b0345f8885b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:07.145315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458d5ff-4abd-4130-9b57-1b0345f8885b None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77/users/a4295442f0a24c02babd7372c9e6af08/roles/6be1975947cd4b948b86c73132244927` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:07.147963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458d5ff-4abd-4130-9b57-1b0345f8885b None admin] RBAC: Authorizing `identity:create_grant(project_id=c75a8d1aa0614b1aa01db2d404827c77, user_id=a4295442f0a24c02babd7372c9e6af08, role_id=6be1975947cd4b948b86c73132244927)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:07.149750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458d5ff-4abd-4130-9b57-1b0345f8885b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:07.155183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e79c2-27e7-4fa0-b4c1-735f93aac9a9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:07.175462 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 127/264] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:11:06 2022] PUT /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77/users/a4295442f0a24c02babd7372c9e6af08/roles/6be1975947cd4b948b86c73132244927 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:07.176683 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458d5ff-4abd-4130-9b57-1b0345f8885b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:07.197920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e025d-c053-4bd4-bed3-c66564a10cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:07.198604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e025d-c053-4bd4-bed3-c66564a10cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:07.198946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e025d-c053-4bd4-bed3-c66564a10cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:07.199292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e025d-c053-4bd4-bed3-c66564a10cb4 None admin] PATH_INFO: `/v3/users/e0fdc16acc60474a8b631c28fe91edc9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:07.201331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e025d-c053-4bd4-bed3-c66564a10cb4 None admin] RBAC: Authorizing `identity:get_user(user_id=e0fdc16acc60474a8b631c28fe91edc9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:07.204063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e025d-c053-4bd4-bed3-c66564a10cb4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:07.205689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 138/265] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:11:07 2022] GET /identity/v3/users/e0fdc16acc60474a8b631c28fe91edc9 => generated 284 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:07.212345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e025d-c053-4bd4-bed3-c66564a10cb4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:07.233020 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:07.345866 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e025d-c053-4bd4-bed3-c66564a10cb4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:07.388858 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b44d43-a724-4a5a-8df4-c7af8cd321a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:07.389483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b44d43-a724-4a5a-8df4-c7af8cd321a0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:07.389787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b44d43-a724-4a5a-8df4-c7af8cd321a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:07.390550 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b44d43-a724-4a5a-8df4-c7af8cd321a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:07.395649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458d5ff-4abd-4130-9b57-1b0345f8885b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:07.469322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294a7f8-d0b5-4a66-98b3-13e23639860f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:07.470367 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294a7f8-d0b5-4a66-98b3-13e23639860f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:07.470848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294a7f8-d0b5-4a66-98b3-13e23639860f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:07.471423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294a7f8-d0b5-4a66-98b3-13e23639860f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:07.472420 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294a7f8-d0b5-4a66-98b3-13e23639860f None admin] RBAC: Adding query filter params (role.id=97ece22f2e264e0e857d5107325a85d9, scope.project.id=c75a8d1aa0614b1aa01db2d404827c77, user.id=e0fdc16acc60474a8b631c28fe91edc9) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:07.472949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294a7f8-d0b5-4a66-98b3-13e23639860f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:07.474981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294a7f8-d0b5-4a66-98b3-13e23639860f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:07.477481 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b44d43-a724-4a5a-8df4-c7af8cd321a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:07.480908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b44d43-a724-4a5a-8df4-c7af8cd321a0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:07.491299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 128/266] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:11:07 2022] GET /identity/v3/role_assignments?user.id=e0fdc16acc60474a8b631c28fe91edc9&scope.project.id=c75a8d1aa0614b1aa01db2d404827c77&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 610 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:07.494799 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:07.591294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 139/267] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:07 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:11:07.597172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294a7f8-d0b5-4a66-98b3-13e23639860f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:07.626083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:07.715919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294a7f8-d0b5-4a66-98b3-13e23639860f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:07.755051 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c956d72-a72b-463a-9e54-d027371a5c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:07.755620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c956d72-a72b-463a-9e54-d027371a5c2e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:07.755904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c956d72-a72b-463a-9e54-d027371a5c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:07.756751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c956d72-a72b-463a-9e54-d027371a5c2e None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:07.757950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c956d72-a72b-463a-9e54-d027371a5c2e None admin] RBAC: Authorizing `identity:get_project(project_id=c75a8d1aa0614b1aa01db2d404827c77)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:07.759439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c956d72-a72b-463a-9e54-d027371a5c2e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:07.761328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 129/268] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:07 2022] GET /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77 => generated 303 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:07.767287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b44d43-a724-4a5a-8df4-c7af8cd321a0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:07.813934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b807259-5df1-4c5a-845d-8b78eb7f204d None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:07.814220 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b807259-5df1-4c5a-845d-8b78eb7f204d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:07.814486 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b807259-5df1-4c5a-845d-8b78eb7f204d None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:07.816297 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 130/269] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:07.822184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065181d-51e7-482a-9868-e8d4a2357468 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:07.822469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065181d-51e7-482a-9868-e8d4a2357468 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:07.822748 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065181d-51e7-482a-9868-e8d4a2357468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:07.857893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3065181d-51e7-482a-9868-e8d4a2357468 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:07.860798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3065181d-51e7-482a-9868-e8d4a2357468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:07.935339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b44d43-a724-4a5a-8df4-c7af8cd321a0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:07.951491 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:07.971399 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 131/270] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:07.972951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7c5a3-b4fe-4d56-82f2-1daed23256fb None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:07.980620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7c5a3-b4fe-4d56-82f2-1daed23256fb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:07.980620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7c5a3-b4fe-4d56-82f2-1daed23256fb None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:07.980620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 132/271] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:07 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:07.980620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471dd3d-a8e8-4022-8171-d4ff6b651316 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:07.980620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471dd3d-a8e8-4022-8171-d4ff6b651316 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:07.980620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471dd3d-a8e8-4022-8171-d4ff6b651316 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:07.981798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 133/272] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:07.987769 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771da96-7728-4927-928f-5c1faf54ae0d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:07.988156 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771da96-7728-4927-928f-5c1faf54ae0d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:07.988460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771da96-7728-4927-928f-5c1faf54ae0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:07.989811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c393cf-c6b9-4c52-a478-92ddb3918330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:07.994183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c393cf-c6b9-4c52-a478-92ddb3918330 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:07.994478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c393cf-c6b9-4c52-a478-92ddb3918330 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:07.994755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c393cf-c6b9-4c52-a478-92ddb3918330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:07.995533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c393cf-c6b9-4c52-a478-92ddb3918330 None admin] RBAC: Adding query filter params (role.id=8801d305c8374d34abe896d3b7685174, scope.project.id=c75a8d1aa0614b1aa01db2d404827c77, user.id=e0fdc16acc60474a8b631c28fe91edc9) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:07.995843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c393cf-c6b9-4c52-a478-92ddb3918330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:08.000475 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c393cf-c6b9-4c52-a478-92ddb3918330 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:08.011732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 140/273] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:11:07 2022] GET /identity/v3/role_assignments?user.id=e0fdc16acc60474a8b631c28fe91edc9&scope.project.id=c75a8d1aa0614b1aa01db2d404827c77&role.id=8801d305c8374d34abe896d3b7685174 => generated 610 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:08.013330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd3126-626b-491f-a630-ecd290d508d7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:08.013819 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd3126-626b-491f-a630-ecd290d508d7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:08.014278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd3126-626b-491f-a630-ecd290d508d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:08.025901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1771da96-7728-4927-928f-5c1faf54ae0d None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:08.027209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1771da96-7728-4927-928f-5c1faf54ae0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:08.035721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8fdd3126-626b-491f-a630-ecd290d508d7 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:08.037373 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8fdd3126-626b-491f-a630-ecd290d508d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:08.049228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:08.130523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 141/274] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:08.190779 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 134/275] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:08.336589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd3126-626b-491f-a630-ecd290d508d7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:08.421826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771da96-7728-4927-928f-5c1faf54ae0d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:08.467558 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd3126-626b-491f-a630-ecd290d508d7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:08.470568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:08.514809 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4f2fa-a0aa-42e1-a9b7-f40d12560706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:08.515450 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4f2fa-a0aa-42e1-a9b7-f40d12560706 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:08.515732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4f2fa-a0aa-42e1-a9b7-f40d12560706 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:08.515981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4f2fa-a0aa-42e1-a9b7-f40d12560706 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:08.532589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4f2fa-a0aa-42e1-a9b7-f40d12560706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:08.538038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-69c4f2fa-a0aa-42e1-a9b7-f40d12560706 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:08.538038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:08.538038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:08.538038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:08.538038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:08.538038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:08.538038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:08.538038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:08.538038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:08.538038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:08.538038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:08.538038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:08.538038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:08.538038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:08.538038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:08.538038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:08.539118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:08.539118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:08.539118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:08.539118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:08.539118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:08.539118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:08.539118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:08.539118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:08.539118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:08.539118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:08.539118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:08.539118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:08.539118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:08.539118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:08.539118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:08.539118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:08.539898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:08.539898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:08.539898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:08.539898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:08.539898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:08.539898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:08.539898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:08.539898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:08.539898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:08.539898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:08.539898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:08.539898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:08.539898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 142/276] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:08.540691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4f2fa-a0aa-42e1-a9b7-f40d12560706 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:08.571634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771da96-7728-4927-928f-5c1faf54ae0d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:08.612518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa061ef9-9386-48e7-aa30-871d28ca4f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:08.613113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa061ef9-9386-48e7-aa30-871d28ca4f8a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:08.613394 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa061ef9-9386-48e7-aa30-871d28ca4f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:08.613668 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa061ef9-9386-48e7-aa30-871d28ca4f8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:08.615022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa061ef9-9386-48e7-aa30-871d28ca4f8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:08.617581 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa061ef9-9386-48e7-aa30-871d28ca4f8a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:08.624033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 135/277] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:08 2022] GET /identity/v3/domains/default => generated 200 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:08.624033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa061ef9-9386-48e7-aa30-871d28ca4f8a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:08.644928 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:08.686043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4f2fa-a0aa-42e1-a9b7-f40d12560706 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:08.742279 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa061ef9-9386-48e7-aa30-871d28ca4f8a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:08.749123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a098d2-b9e8-428a-89c4-9fd789a579e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:08.750184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a098d2-b9e8-428a-89c4-9fd789a579e1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:08.750665 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a098d2-b9e8-428a-89c4-9fd789a579e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:08.751146 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a098d2-b9e8-428a-89c4-9fd789a579e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:08.765825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a098d2-b9e8-428a-89c4-9fd789a579e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:08.770959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-07a098d2-b9e8-428a-89c4-9fd789a579e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:11:08.770959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:08.770959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:08.770959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:08.770959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:08.770959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:08.770959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:08.770959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:08.770959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:08.770959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:08.770959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:08.770959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:08.770959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:08.770959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:08.770959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:08.770959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:08.773042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:08.773042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:08.773042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:08.773042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:08.773042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:08.773042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:08.773042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:08.773042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:08.773042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:08.773042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:08.773042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:08.773042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:08.773042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:08.773042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:08.773042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:08.773042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:08.774057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:08.774057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:08.774057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:08.774057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:08.774057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:08.774057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:08.774057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:08.774057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:08.774057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:08.774057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:08.774057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:11:08.774057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:08.774057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 143/278] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:08.774057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a098d2-b9e8-428a-89c4-9fd789a579e1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:08.792085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067647c-7f50-48cf-9aab-a9badab44370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:08.793164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067647c-7f50-48cf-9aab-a9badab44370 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:08.793518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067647c-7f50-48cf-9aab-a9badab44370 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:08.793798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067647c-7f50-48cf-9aab-a9badab44370 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:08.794636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067647c-7f50-48cf-9aab-a9badab44370 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:08.794942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067647c-7f50-48cf-9aab-a9badab44370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:08.796430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067647c-7f50-48cf-9aab-a9badab44370 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:08.800362 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:08.807021 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 136/279] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:11:08 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:08.807021 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067647c-7f50-48cf-9aab-a9badab44370 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:08.886553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a098d2-b9e8-428a-89c4-9fd789a579e1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:08.906558 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:08.923083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76117d-9ecf-4fda-a3e4-e93befa74160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:08.923687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76117d-9ecf-4fda-a3e4-e93befa74160 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:08.923962 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76117d-9ecf-4fda-a3e4-e93befa74160 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:08.924230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76117d-9ecf-4fda-a3e4-e93befa74160 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:08.924899 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76117d-9ecf-4fda-a3e4-e93befa74160 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:08.926360 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76117d-9ecf-4fda-a3e4-e93befa74160 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:08.930608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067647c-7f50-48cf-9aab-a9badab44370 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:08.951277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 144/280] 10.222.0.107 () {60 vars in 1137 bytes} [Tue Aug 23 23:11:08 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:11:08.952261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76117d-9ecf-4fda-a3e4-e93befa74160 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:08.985562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee3afa-28af-43db-9dc6-8feb538cde1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:08.986182 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee3afa-28af-43db-9dc6-8feb538cde1a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:08.986454 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee3afa-28af-43db-9dc6-8feb538cde1a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:08.986724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee3afa-28af-43db-9dc6-8feb538cde1a None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:08.987455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee3afa-28af-43db-9dc6-8feb538cde1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:08.988009 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee3afa-28af-43db-9dc6-8feb538cde1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:08.990032 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee3afa-28af-43db-9dc6-8feb538cde1a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:09.010799 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 137/281] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:11:08 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:09.012287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee3afa-28af-43db-9dc6-8feb538cde1a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:09.083537 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:09.108484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76117d-9ecf-4fda-a3e4-e93befa74160 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:09.157509 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889f4ce-7118-45af-b699-c69cd7904e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:09.157509 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889f4ce-7118-45af-b699-c69cd7904e4c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:09.157795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889f4ce-7118-45af-b699-c69cd7904e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:09.157880 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889f4ce-7118-45af-b699-c69cd7904e4c None admin] PATH_INFO: `/v3/users/a6d67b0deb22489c9c5fda8e22afa9bb` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:09.163536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee3afa-28af-43db-9dc6-8feb538cde1a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:09.176149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889f4ce-7118-45af-b699-c69cd7904e4c None admin] RBAC: Authorizing `identity:get_user(user_id=a6d67b0deb22489c9c5fda8e22afa9bb)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:09.178651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889f4ce-7118-45af-b699-c69cd7904e4c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:09.180563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 145/282] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:11:08 2022] GET /identity/v3/users/a6d67b0deb22489c9c5fda8e22afa9bb => generated 294 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:09.189688 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889f4ce-7118-45af-b699-c69cd7904e4c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:09.207317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7526a67-dd8b-426f-99da-9be6c7fc6758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:09.208006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7526a67-dd8b-426f-99da-9be6c7fc6758 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:09.208285 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7526a67-dd8b-426f-99da-9be6c7fc6758 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:09.208556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7526a67-dd8b-426f-99da-9be6c7fc6758 None admin] PATH_INFO: `/v3/users/d98c5e918de34d4baa05adb432345aa6` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:09.210292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7526a67-dd8b-426f-99da-9be6c7fc6758 None admin] RBAC: Authorizing `identity:get_user(user_id=d98c5e918de34d4baa05adb432345aa6)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:09.211863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7526a67-dd8b-426f-99da-9be6c7fc6758 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:09.213721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 138/283] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:11:09 2022] GET /identity/v3/users/d98c5e918de34d4baa05adb432345aa6 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:09.219721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7526a67-dd8b-426f-99da-9be6c7fc6758 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:09.234400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:09.332098 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889f4ce-7118-45af-b699-c69cd7904e4c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:09.365942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7526a67-dd8b-426f-99da-9be6c7fc6758 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:09.379931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5192c25-9faa-4dfe-bdf0-7cb8ac3ba5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:09.380561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5192c25-9faa-4dfe-bdf0-7cb8ac3ba5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:09.380864 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5192c25-9faa-4dfe-bdf0-7cb8ac3ba5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:09.381671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5192c25-9faa-4dfe-bdf0-7cb8ac3ba5e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:09.382538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5192c25-9faa-4dfe-bdf0-7cb8ac3ba5e9 None admin] RBAC: Adding query filter params (role.id=6be1975947cd4b948b86c73132244927, user.id=a6d67b0deb22489c9c5fda8e22afa9bb, scope.system=all) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:09.382875 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5192c25-9faa-4dfe-bdf0-7cb8ac3ba5e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:09.384519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5192c25-9faa-4dfe-bdf0-7cb8ac3ba5e9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:09.390560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 146/284] 10.222.0.107 () {56 vars in 1313 bytes} [Tue Aug 23 23:11:09 2022] GET /identity/v3/role_assignments?user.id=a6d67b0deb22489c9c5fda8e22afa9bb&scope.system=all&role.id=6be1975947cd4b948b86c73132244927 => generated 227 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:09.419290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a75d8-ccf3-447b-a81e-79bdb1ae4d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:09.419845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a75d8-ccf3-447b-a81e-79bdb1ae4d61 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:09.420120 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a75d8-ccf3-447b-a81e-79bdb1ae4d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:09.420386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a75d8-ccf3-447b-a81e-79bdb1ae4d61 None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:09.421875 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a75d8-ccf3-447b-a81e-79bdb1ae4d61 None admin] RBAC: Authorizing `identity:get_project(project_id=c75a8d1aa0614b1aa01db2d404827c77)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:09.423843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a75d8-ccf3-447b-a81e-79bdb1ae4d61 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:09.426186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 139/285] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:09 2022] GET /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77 => generated 303 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:09.432771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5192c25-9faa-4dfe-bdf0-7cb8ac3ba5e9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:09.442141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:09.590894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5192c25-9faa-4dfe-bdf0-7cb8ac3ba5e9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:09.630753 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9b1c8-8d0a-405f-948e-cdca1e0aafb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:09.631996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9b1c8-8d0a-405f-948e-cdca1e0aafb4 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:09.632272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9b1c8-8d0a-405f-948e-cdca1e0aafb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:09.632540 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9b1c8-8d0a-405f-948e-cdca1e0aafb4 None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77/users/d98c5e918de34d4baa05adb432345aa6/roles/3d0598848b8f4a18917b5dbb657caa63` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:09.635022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9b1c8-8d0a-405f-948e-cdca1e0aafb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c75a8d1aa0614b1aa01db2d404827c77, user_id=d98c5e918de34d4baa05adb432345aa6, role_id=3d0598848b8f4a18917b5dbb657caa63)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:09.636467 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9b1c8-8d0a-405f-948e-cdca1e0aafb4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:09.652569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 147/286] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:11:09 2022] PUT /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77/users/d98c5e918de34d4baa05adb432345aa6/roles/3d0598848b8f4a18917b5dbb657caa63 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:09.712749 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7612c30-3f44-40d1-b36a-7ccd74d1be23 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:09.713089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7612c30-3f44-40d1-b36a-7ccd74d1be23 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:09.713302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7612c30-3f44-40d1-b36a-7ccd74d1be23 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:09.715180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 140/287] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:09.720843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522c9bd-7301-4466-971a-9475f33d1a5f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:09.721155 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522c9bd-7301-4466-971a-9475f33d1a5f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:09.721453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522c9bd-7301-4466-971a-9475f33d1a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:09.754024 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b522c9bd-7301-4466-971a-9475f33d1a5f None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:09.755278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b522c9bd-7301-4466-971a-9475f33d1a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:09.827410 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:09.841787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 148/288] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:10.148639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7612c30-3f44-40d1-b36a-7ccd74d1be23 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:10.305936 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:10.340738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7612c30-3f44-40d1-b36a-7ccd74d1be23 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:10.395392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf37d1b-67b4-4db7-a990-4e53a18ebe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:10.396036 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf37d1b-67b4-4db7-a990-4e53a18ebe24 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:10.396358 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf37d1b-67b4-4db7-a990-4e53a18ebe24 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:10.396638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf37d1b-67b4-4db7-a990-4e53a18ebe24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:10.414971 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf37d1b-67b4-4db7-a990-4e53a18ebe24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:10.420710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-5cf37d1b-67b4-4db7-a990-4e53a18ebe24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:10.420710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:10.420710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:10.420710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:10.420710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:10.420710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:10.420710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:10.420710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:10.420710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:10.420710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:10.420710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:10.420710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:10.420710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:10.420710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:10.420710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:10.420710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:10.422263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:10.422263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:10.422263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:10.422263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:10.422263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:10.422263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:10.422263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:10.422263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:10.422263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:10.422263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:10.422263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:10.422263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:10.422263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:10.422263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:10.422263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:10.422263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:10.423671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:10.423671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:10.423671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:10.423671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:10.423671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:10.423671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:10.423671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:10.423671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:10.423671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:10.423671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:10.423671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:10.423671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:10.423671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 141/289] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:10.428011 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522c9bd-7301-4466-971a-9475f33d1a5f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:10.590767 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522c9bd-7301-4466-971a-9475f33d1a5f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:10.654519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a57585-e1e6-4c09-a81c-0c1fcdbae3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:10.655535 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a57585-e1e6-4c09-a81c-0c1fcdbae3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:10.656013 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a57585-e1e6-4c09-a81c-0c1fcdbae3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:10.656492 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a57585-e1e6-4c09-a81c-0c1fcdbae3d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:10.657736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a57585-e1e6-4c09-a81c-0c1fcdbae3d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:10.658274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a57585-e1e6-4c09-a81c-0c1fcdbae3d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:10.660835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a57585-e1e6-4c09-a81c-0c1fcdbae3d2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:10.678338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 149/290] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:11:10 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:10.684354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf37d1b-67b4-4db7-a990-4e53a18ebe24 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:10.915597 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf37d1b-67b4-4db7-a990-4e53a18ebe24 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:11.007818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667f9aa-c690-4f82-a43d-c72ae65fb237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:11.008692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667f9aa-c690-4f82-a43d-c72ae65fb237 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:11.008978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667f9aa-c690-4f82-a43d-c72ae65fb237 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:11.009255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667f9aa-c690-4f82-a43d-c72ae65fb237 None admin] PATH_INFO: `/v3/users/a4295442f0a24c02babd7372c9e6af08` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:11.010754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667f9aa-c690-4f82-a43d-c72ae65fb237 None admin] RBAC: Authorizing `identity:get_user(user_id=a4295442f0a24c02babd7372c9e6af08)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:11.012494 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667f9aa-c690-4f82-a43d-c72ae65fb237 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:11.015278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 142/291] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:11:10 2022] GET /identity/v3/users/a4295442f0a24c02babd7372c9e6af08 => generated 298 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:11.021031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a57585-e1e6-4c09-a81c-0c1fcdbae3d2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:11.148206 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:11.211479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a57585-e1e6-4c09-a81c-0c1fcdbae3d2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:11.307558 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f6077-13e1-4a71-8b67-94760bfb2ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:11.308630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f6077-13e1-4a71-8b67-94760bfb2ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:11.309141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f6077-13e1-4a71-8b67-94760bfb2ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:11.309632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f6077-13e1-4a71-8b67-94760bfb2ba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:11.464433 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f6077-13e1-4a71-8b67-94760bfb2ba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:11.467272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f6077-13e1-4a71-8b67-94760bfb2ba0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:11.601291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:11.721683 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 150/292] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:11 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:11.729177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667f9aa-c690-4f82-a43d-c72ae65fb237 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:11.757525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:11.938480 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667f9aa-c690-4f82-a43d-c72ae65fb237 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:12.000314 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ef5d8-3e07-438a-ace0-badd1664681c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:12.000900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ef5d8-3e07-438a-ace0-badd1664681c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:12.001372 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ef5d8-3e07-438a-ace0-badd1664681c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:12.007397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 151/293] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:12.009986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfc713-d083-40b3-8863-26529804f2b0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:12.010302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfc713-d083-40b3-8863-26529804f2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:12.010610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfc713-d083-40b3-8863-26529804f2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:12.029587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608bef8-30d3-45e0-b25c-b76e9ab2dd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:12.036626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608bef8-30d3-45e0-b25c-b76e9ab2dd1e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:12.036626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608bef8-30d3-45e0-b25c-b76e9ab2dd1e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:12.036626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608bef8-30d3-45e0-b25c-b76e9ab2dd1e None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:12.036626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608bef8-30d3-45e0-b25c-b76e9ab2dd1e None admin] RBAC: Authorizing `identity:get_project(project_id=c75a8d1aa0614b1aa01db2d404827c77)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:12.037011 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608bef8-30d3-45e0-b25c-b76e9ab2dd1e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:12.040737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 143/294] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:11 2022] GET /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77 => generated 303 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:12.047151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608bef8-30d3-45e0-b25c-b76e9ab2dd1e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:12.065792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d5dfc713-d083-40b3-8863-26529804f2b0 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:12.067037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d5dfc713-d083-40b3-8863-26529804f2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:12.203136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:12.258204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608bef8-30d3-45e0-b25c-b76e9ab2dd1e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:12.275101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 152/295] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:12.332292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44447062-c6f4-4668-98e8-03f6a9b09506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:12.333439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447062-c6f4-4668-98e8-03f6a9b09506 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:12.333932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447062-c6f4-4668-98e8-03f6a9b09506 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:12.334477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447062-c6f4-4668-98e8-03f6a9b09506 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:12.335869 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44447062-c6f4-4668-98e8-03f6a9b09506 None admin] RBAC: Adding query filter params (role.id=6be1975947cd4b948b86c73132244927, scope.project.id=c75a8d1aa0614b1aa01db2d404827c77, user.id=a4295442f0a24c02babd7372c9e6af08) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:12.336409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44447062-c6f4-4668-98e8-03f6a9b09506 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:12.339320 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44447062-c6f4-4668-98e8-03f6a9b09506 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:12.354939 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 144/296] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:11:12 2022] GET /identity/v3/role_assignments?user.id=a4295442f0a24c02babd7372c9e6af08&scope.project.id=c75a8d1aa0614b1aa01db2d404827c77&role.id=6be1975947cd4b948b86c73132244927 => generated 610 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:12.414462 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17283ef6-68fb-4b72-8c3f-584774bddfae None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:12.414732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17283ef6-68fb-4b72-8c3f-584774bddfae None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:12.415082 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17283ef6-68fb-4b72-8c3f-584774bddfae None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:12.417154 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 153/297] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:12.423002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251579d-a145-491d-b3ed-335581bb7223 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:12.423301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251579d-a145-491d-b3ed-335581bb7223 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:12.423547 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251579d-a145-491d-b3ed-335581bb7223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:12.444567 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c251579d-a145-491d-b3ed-335581bb7223 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:12.445874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c251579d-a145-491d-b3ed-335581bb7223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:12.542674 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 145/298] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:12.671727 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b2425-308a-4936-af06-dd478fc6d490 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:12.672049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b2425-308a-4936-af06-dd478fc6d490 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:12.672276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b2425-308a-4936-af06-dd478fc6d490 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:12.674031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 154/299] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:12.682014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44612c9d-ce47-447f-a33d-a3ef23ee61f0 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:12.682316 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44612c9d-ce47-447f-a33d-a3ef23ee61f0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:12.682560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44612c9d-ce47-447f-a33d-a3ef23ee61f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:12.712290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-44612c9d-ce47-447f-a33d-a3ef23ee61f0 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:12.713985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-44612c9d-ce47-447f-a33d-a3ef23ee61f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:12.739434 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b2425-308a-4936-af06-dd478fc6d490 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:12.810179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:12.819986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 146/300] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:12.821826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1ea6d-7da0-4e16-ac03-faddf201f490 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:12.822213 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1ea6d-7da0-4e16-ac03-faddf201f490 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:12.822680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1ea6d-7da0-4e16-ac03-faddf201f490 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:12.829321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 147/301] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:12 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:12.830853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a75132-90c5-4159-bdbf-764ca5a4c3a1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:12.831140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a75132-90c5-4159-bdbf-764ca5a4c3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:12.831415 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a75132-90c5-4159-bdbf-764ca5a4c3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:12.853175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a2a75132-90c5-4159-bdbf-764ca5a4c3a1 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:12.854656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a2a75132-90c5-4159-bdbf-764ca5a4c3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:12.900622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:12.922585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b2425-308a-4936-af06-dd478fc6d490 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:12.944767 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 148/302] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:12.944767 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a75132-90c5-4159-bdbf-764ca5a4c3a1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:12.981528 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7ad55-07f4-4794-89e8-da3330057b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:12.982541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ad55-07f4-4794-89e8-da3330057b5e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:12.982887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ad55-07f4-4794-89e8-da3330057b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:12.983224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ad55-07f4-4794-89e8-da3330057b5e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:13.004537 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7ad55-07f4-4794-89e8-da3330057b5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:13.013066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-7df7ad55-07f4-4794-89e8-da3330057b5e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:11:13.013066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:13.013066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:13.013066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:13.013066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:13.013066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:13.013066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:13.013066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:13.013066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:13.013066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:13.013066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:13.013066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:13.013066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:13.013066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:13.013066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:13.013066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:13.014459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:13.014459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:13.014459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:13.014459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:13.014459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:13.014459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:13.014459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:13.014459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:13.014459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:13.014459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:13.014459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:13.014459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:13.014459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:13.014459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:13.014459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:13.014459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:13.015682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:13.015682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:13.015682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:13.015682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:13.015682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:13.015682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:13.015682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:13.015682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:13.015682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:13.015682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:13.015682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:11:13.015682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:13.024906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 155/303] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:11:13.031922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7ad55-07f4-4794-89e8-da3330057b5e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:13.102938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a75132-90c5-4159-bdbf-764ca5a4c3a1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:13.135638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:13.145751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e47650-9253-4b34-b717-ccc7ad0fc952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:13.146398 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e47650-9253-4b34-b717-ccc7ad0fc952 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:13.146680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e47650-9253-4b34-b717-ccc7ad0fc952 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:13.147692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e47650-9253-4b34-b717-ccc7ad0fc952 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:13.159203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e47650-9253-4b34-b717-ccc7ad0fc952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:13.164144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-55e47650-9253-4b34-b717-ccc7ad0fc952 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:13.164144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:13.164144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:13.164144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:13.164144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:13.164144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:13.164144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:13.164144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:13.164144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:13.164144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:13.164144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:13.164144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:13.164144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:13.164144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:13.164144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:13.164144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:13.165322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:13.165322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:13.165322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:13.165322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:13.165322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:13.165322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:13.165322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:13.165322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:13.165322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:13.165322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:13.165322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:13.165322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:13.165322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:13.165322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:13.165322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:13.165322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:13.167497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:13.167497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:13.167497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:13.167497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:13.167497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:13.167497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:13.167497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:13.167497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:13.167497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:13.167497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:13.167497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:13.167497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:13.167497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 149/304] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:13.167497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e47650-9253-4b34-b717-ccc7ad0fc952 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:13.175159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7ad55-07f4-4794-89e8-da3330057b5e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:13.226702 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c24d1-f755-4c3c-a9d4-7b83d597cca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:13.227757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c24d1-f755-4c3c-a9d4-7b83d597cca8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:13.228811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c24d1-f755-4c3c-a9d4-7b83d597cca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:13.229407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c24d1-f755-4c3c-a9d4-7b83d597cca8 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:13.230163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c24d1-f755-4c3c-a9d4-7b83d597cca8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:13.230478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c24d1-f755-4c3c-a9d4-7b83d597cca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:13.231972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c24d1-f755-4c3c-a9d4-7b83d597cca8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:13.242185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 156/305] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:11:13 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:13.245595 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c24d1-f755-4c3c-a9d4-7b83d597cca8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:13.258965 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:13.295546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e47650-9253-4b34-b717-ccc7ad0fc952 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:13.333514 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3900d-18ec-4853-80a0-17080812bc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:13.334157 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3900d-18ec-4853-80a0-17080812bc39 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:13.334437 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3900d-18ec-4853-80a0-17080812bc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:13.335420 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3900d-18ec-4853-80a0-17080812bc39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:13.335986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3900d-18ec-4853-80a0-17080812bc39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:13.337491 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3900d-18ec-4853-80a0-17080812bc39 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:13.339347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 150/306] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:13 2022] GET /identity/v3/domains/default => generated 200 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:13.340002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3900d-18ec-4853-80a0-17080812bc39 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:13.371872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c24d1-f755-4c3c-a9d4-7b83d597cca8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:13.411080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:13.418825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18f0cf-0ba4-4e58-b0b0-2c0a80cfe297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:13.419527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f0cf-0ba4-4e58-b0b0-2c0a80cfe297 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:13.419813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f0cf-0ba4-4e58-b0b0-2c0a80cfe297 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:13.420090 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18f0cf-0ba4-4e58-b0b0-2c0a80cfe297 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:13.421464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18f0cf-0ba4-4e58-b0b0-2c0a80cfe297 None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:13.421464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18f0cf-0ba4-4e58-b0b0-2c0a80cfe297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:13.422592 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18f0cf-0ba4-4e58-b0b0-2c0a80cfe297 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:13.432099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 157/307] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:11:13 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:13.433171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18f0cf-0ba4-4e58-b0b0-2c0a80cfe297 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:13.466624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3900d-18ec-4853-80a0-17080812bc39 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:13.509337 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324829d5-8172-4761-853a-6b86b51a4af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:13.510202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324829d5-8172-4761-853a-6b86b51a4af2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:13.510672 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324829d5-8172-4761-853a-6b86b51a4af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:13.511184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324829d5-8172-4761-853a-6b86b51a4af2 None admin] PATH_INFO: `/v3/users/59d84674aba14d6baefc53afa60420b3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:13.512453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:13.527496 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324829d5-8172-4761-853a-6b86b51a4af2 None admin] RBAC: Authorizing `identity:get_user(user_id=59d84674aba14d6baefc53afa60420b3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:13.529353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324829d5-8172-4761-853a-6b86b51a4af2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:13.530908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 151/308] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:11:13 2022] GET /identity/v3/users/59d84674aba14d6baefc53afa60420b3 => generated 294 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:13.531674 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324829d5-8172-4761-853a-6b86b51a4af2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:13.552478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18f0cf-0ba4-4e58-b0b0-2c0a80cfe297 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:13.603912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde59c-c238-43f4-bef3-c2d6493bf7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:13.604650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde59c-c238-43f4-bef3-c2d6493bf7ac None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:13.604950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde59c-c238-43f4-bef3-c2d6493bf7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:13.605773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde59c-c238-43f4-bef3-c2d6493bf7ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:13.617323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafde59c-c238-43f4-bef3-c2d6493bf7ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:13.623932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-eafde59c-c238-43f4-bef3-c2d6493bf7ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:11:13.623932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:13.623932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:13.623932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:13.623932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:13.623932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:13.623932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:13.623932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:13.623932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:13.623932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:13.623932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:13.623932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:13.623932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:13.623932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:13.623932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:13.623932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:13.624905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:13.624905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:13.624905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:13.624905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:13.624905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:13.624905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:13.624905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:13.624905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:13.624905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:13.624905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:13.624905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:13.624905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:13.624905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:13.624905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:13.624905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:13.624905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:13.625724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:13.625724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:13.625724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:13.625724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:13.625724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:13.625724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:13.625724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:13.625724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:13.625724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:13.625724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:13.625724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:11:13.625724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:13.625724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 158/309] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:13.626375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde59c-c238-43f4-bef3-c2d6493bf7ac None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:13.653085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324829d5-8172-4761-853a-6b86b51a4af2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:13.668877 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:13.693600 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ebce9-2ec0-432d-8bd1-f26bb8ebe327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:13.694252 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ebce9-2ec0-432d-8bd1-f26bb8ebe327 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:13.694523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ebce9-2ec0-432d-8bd1-f26bb8ebe327 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:13.694796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ebce9-2ec0-432d-8bd1-f26bb8ebe327 None admin] PATH_INFO: `/v3/groups` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:13.695431 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ebce9-2ec0-432d-8bd1-f26bb8ebe327 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:13.696905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ebce9-2ec0-432d-8bd1-f26bb8ebe327 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:13.715284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 152/310] 10.222.0.107 () {60 vars in 1139 bytes} [Tue Aug 23 23:11:13 2022] POST /identity/v3/groups => generated 230 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:11:13.716181 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ebce9-2ec0-432d-8bd1-f26bb8ebe327 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:13.746391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde59c-c238-43f4-bef3-c2d6493bf7ac None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:13.780017 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:13.792436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbf695-d162-411d-9663-867c45b8f6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:13.793315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbf695-d162-411d-9663-867c45b8f6df None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:13.793813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbf695-d162-411d-9663-867c45b8f6df None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:13.794302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbf695-d162-411d-9663-867c45b8f6df None admin] PATH_INFO: `/v3/users/a6d67b0deb22489c9c5fda8e22afa9bb` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:13.796450 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbf695-d162-411d-9663-867c45b8f6df None admin] RBAC: Authorizing `identity:get_user(user_id=a6d67b0deb22489c9c5fda8e22afa9bb)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:13.798478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbf695-d162-411d-9663-867c45b8f6df None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:13.801092 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 159/311] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:11:13 2022] GET /identity/v3/users/a6d67b0deb22489c9c5fda8e22afa9bb => generated 294 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:13.802434 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbf695-d162-411d-9663-867c45b8f6df None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:13.871715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ebce9-2ec0-432d-8bd1-f26bb8ebe327 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:13.934085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb530e02-41e2-4378-9a90-def568248e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:13.934943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb530e02-41e2-4378-9a90-def568248e23 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:13.935390 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb530e02-41e2-4378-9a90-def568248e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:13.935837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb530e02-41e2-4378-9a90-def568248e23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:13.940777 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb530e02-41e2-4378-9a90-def568248e23 None admin] RBAC: Adding query filter params (role.id=3d0598848b8f4a18917b5dbb657caa63, user.id=59d84674aba14d6baefc53afa60420b3, scope.system=all) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:13.940777 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb530e02-41e2-4378-9a90-def568248e23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:13.940777 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb530e02-41e2-4378-9a90-def568248e23 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:13.951801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 153/312] 10.222.0.107 () {56 vars in 1313 bytes} [Tue Aug 23 23:11:13 2022] GET /identity/v3/role_assignments?user.id=59d84674aba14d6baefc53afa60420b3&scope.system=all&role.id=3d0598848b8f4a18917b5dbb657caa63 => generated 227 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:13.957244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb530e02-41e2-4378-9a90-def568248e23 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:13.989453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbf695-d162-411d-9663-867c45b8f6df None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:14.037308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24848b0e-7377-4ec1-90cf-708752ceefd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:14.038401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24848b0e-7377-4ec1-90cf-708752ceefd3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:14.038893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24848b0e-7377-4ec1-90cf-708752ceefd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:14.039398 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24848b0e-7377-4ec1-90cf-708752ceefd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:14.040318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24848b0e-7377-4ec1-90cf-708752ceefd3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:14.040940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:14.042574 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24848b0e-7377-4ec1-90cf-708752ceefd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:14.045722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24848b0e-7377-4ec1-90cf-708752ceefd3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:14.064212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 160/313] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:11:13 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:14.066178 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24848b0e-7377-4ec1-90cf-708752ceefd3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:14.138682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb530e02-41e2-4378-9a90-def568248e23 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:14.170988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:14.191630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d7461-2b69-46ad-9805-ec9febaae33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:14.192295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d7461-2b69-46ad-9805-ec9febaae33e None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:14.192646 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d7461-2b69-46ad-9805-ec9febaae33e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:14.192980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d7461-2b69-46ad-9805-ec9febaae33e None admin] PATH_INFO: `/v3/system/users/a6d67b0deb22489c9c5fda8e22afa9bb/roles/6be1975947cd4b948b86c73132244927` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:14.194735 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d7461-2b69-46ad-9805-ec9febaae33e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a6d67b0deb22489c9c5fda8e22afa9bb, role_id=6be1975947cd4b948b86c73132244927)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:14.196205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d7461-2b69-46ad-9805-ec9febaae33e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:14.213002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 154/314] 10.222.0.107 () {58 vars in 1339 bytes} [Tue Aug 23 23:11:13 2022] PUT /identity/v3/system/users/a6d67b0deb22489c9c5fda8e22afa9bb/roles/6be1975947cd4b948b86c73132244927 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:14.258089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24848b0e-7377-4ec1-90cf-708752ceefd3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:14.321965 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f99b2-daae-4af4-b9a3-5ebf73c6974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:14.322716 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f99b2-daae-4af4-b9a3-5ebf73c6974c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:14.323070 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f99b2-daae-4af4-b9a3-5ebf73c6974c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:14.323424 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f99b2-daae-4af4-b9a3-5ebf73c6974c None admin] PATH_INFO: `/v3/users/d98c5e918de34d4baa05adb432345aa6` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:14.324796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f99b2-daae-4af4-b9a3-5ebf73c6974c None admin] RBAC: Authorizing `identity:get_user(user_id=d98c5e918de34d4baa05adb432345aa6)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:14.326555 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f99b2-daae-4af4-b9a3-5ebf73c6974c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:14.329773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 161/315] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:11:14 2022] GET /identity/v3/users/d98c5e918de34d4baa05adb432345aa6 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:14.339358 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d7461-2b69-46ad-9805-ec9febaae33e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:14.546715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d7461-2b69-46ad-9805-ec9febaae33e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:14.549925 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:14.615966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480d6dc-0437-4bb3-8e9d-cdb67b13b382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:14.617305 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480d6dc-0437-4bb3-8e9d-cdb67b13b382 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:14.617970 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480d6dc-0437-4bb3-8e9d-cdb67b13b382 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:14.618625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480d6dc-0437-4bb3-8e9d-cdb67b13b382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:14.750522 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480d6dc-0437-4bb3-8e9d-cdb67b13b382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:14.753519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480d6dc-0437-4bb3-8e9d-cdb67b13b382 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:14.921986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 155/316] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:14 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:14.931630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f99b2-daae-4af4-b9a3-5ebf73c6974c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:15.112931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f99b2-daae-4af4-b9a3-5ebf73c6974c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:15.142666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:15.153727 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a9c3c-78f4-43b0-ac21-62bd1d0f1c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:15.155005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a9c3c-78f4-43b0-ac21-62bd1d0f1c6b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:15.155566 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a9c3c-78f4-43b0-ac21-62bd1d0f1c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:15.156276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a9c3c-78f4-43b0-ac21-62bd1d0f1c6b None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:15.157618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a9c3c-78f4-43b0-ac21-62bd1d0f1c6b None admin] RBAC: Authorizing `identity:get_project(project_id=c75a8d1aa0614b1aa01db2d404827c77)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:15.159193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a9c3c-78f4-43b0-ac21-62bd1d0f1c6b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:15.161401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 162/317] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:14 2022] GET /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77 => generated 303 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:15.171964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480d6dc-0437-4bb3-8e9d-cdb67b13b382 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:15.175951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:15.356005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480d6dc-0437-4bb3-8e9d-cdb67b13b382 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:15.399740 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812dd12-d1f9-4bb6-9e5e-2c758a5ef467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:15.400356 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812dd12-d1f9-4bb6-9e5e-2c758a5ef467 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:15.400654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812dd12-d1f9-4bb6-9e5e-2c758a5ef467 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:15.400932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812dd12-d1f9-4bb6-9e5e-2c758a5ef467 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:15.401670 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812dd12-d1f9-4bb6-9e5e-2c758a5ef467 None admin] RBAC: Adding query filter params (role.id=3d0598848b8f4a18917b5dbb657caa63, scope.project.id=c75a8d1aa0614b1aa01db2d404827c77, user.id=d98c5e918de34d4baa05adb432345aa6) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:15.401979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812dd12-d1f9-4bb6-9e5e-2c758a5ef467 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:15.403431 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812dd12-d1f9-4bb6-9e5e-2c758a5ef467 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:15.410572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 156/318] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:11:15 2022] GET /identity/v3/role_assignments?user.id=d98c5e918de34d4baa05adb432345aa6&scope.project.id=c75a8d1aa0614b1aa01db2d404827c77&role.id=3d0598848b8f4a18917b5dbb657caa63 => generated 610 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:16.042741 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251750c-59b8-4864-b745-38eb9e60f091 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:16.043434 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251750c-59b8-4864-b745-38eb9e60f091 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:16.043434 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251750c-59b8-4864-b745-38eb9e60f091 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:16.046238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 163/319] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:11:16.052260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a4ddb-bbe6-45ec-8ca6-c705135b1c71 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:16.053141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a4ddb-bbe6-45ec-8ca6-c705135b1c71 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:16.053141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a4ddb-bbe6-45ec-8ca6-c705135b1c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:16.072649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-512a4ddb-bbe6-45ec-8ca6-c705135b1c71 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:16.073887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-512a4ddb-bbe6-45ec-8ca6-c705135b1c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:16.149350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:16.168645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 157/320] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:16.281304 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5dc2b-b216-44c0-a877-7d3d70181bfb None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:16.281488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5dc2b-b216-44c0-a877-7d3d70181bfb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:16.281761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5dc2b-b216-44c0-a877-7d3d70181bfb None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:16.283330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 164/321] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:16.290657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddda27f-6e02-480f-9165-d99da306fada None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:16.290988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddda27f-6e02-480f-9165-d99da306fada None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:16.291203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddda27f-6e02-480f-9165-d99da306fada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:16.314017 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bddda27f-6e02-480f-9165-d99da306fada None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:16.314890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bddda27f-6e02-480f-9165-d99da306fada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:16.408622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 158/322] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:16.453556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5dc2b-b216-44c0-a877-7d3d70181bfb None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:16.590518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5dc2b-b216-44c0-a877-7d3d70181bfb None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:16.632641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8d074-b28f-4f3c-924d-0aad4879d096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:16.633337 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8d074-b28f-4f3c-924d-0aad4879d096 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:16.633610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8d074-b28f-4f3c-924d-0aad4879d096 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:16.633884 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8d074-b28f-4f3c-924d-0aad4879d096 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:16.635048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8d074-b28f-4f3c-924d-0aad4879d096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:16.636535 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8d074-b28f-4f3c-924d-0aad4879d096 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:16.638524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 165/323] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:16 2022] GET /identity/v3/domains/default => generated 200 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:16.644318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddda27f-6e02-480f-9165-d99da306fada None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:16.683566 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8d074-b28f-4f3c-924d-0aad4879d096 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:16.761515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:16.776729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddda27f-6e02-480f-9165-d99da306fada None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:16.806721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:16.814164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8d074-b28f-4f3c-924d-0aad4879d096 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:16.818426 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507519e4-3afd-4c63-95ef-4d8f0cfa05db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:16.819076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507519e4-3afd-4c63-95ef-4d8f0cfa05db None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:16.819352 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507519e4-3afd-4c63-95ef-4d8f0cfa05db None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:16.819623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507519e4-3afd-4c63-95ef-4d8f0cfa05db None admin] PATH_INFO: `/v3/groups` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:16.820262 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507519e4-3afd-4c63-95ef-4d8f0cfa05db None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:16.821764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507519e4-3afd-4c63-95ef-4d8f0cfa05db None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:16.839141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 159/324] 10.222.0.107 () {60 vars in 1139 bytes} [Tue Aug 23 23:11:16 2022] POST /identity/v3/groups => generated 227 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:11:16.840333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d2f8e-ee4e-43d8-8741-8be16af90396 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:16.840640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d2f8e-ee4e-43d8-8741-8be16af90396 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:16.840859 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d2f8e-ee4e-43d8-8741-8be16af90396 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:16.842147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 160/325] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:16.848071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea30db-441e-46af-b212-29f8ca2aa55f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:16.848376 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea30db-441e-46af-b212-29f8ca2aa55f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:16.848714 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea30db-441e-46af-b212-29f8ca2aa55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:16.855430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433db32-a113-4095-8c11-b046c6eae3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:16.856180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433db32-a113-4095-8c11-b046c6eae3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:16.856541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433db32-a113-4095-8c11-b046c6eae3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:16.856823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433db32-a113-4095-8c11-b046c6eae3a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:16.871237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433db32-a113-4095-8c11-b046c6eae3a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:16.877345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-1433db32-a113-4095-8c11-b046c6eae3a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:16.877345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:16.877345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:16.877345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:16.877345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:16.877345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:16.877345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:16.877345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:16.877345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:16.877345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:16.877345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:16.877345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:16.877345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:16.877345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:16.877345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:16.877345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:16.879119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:16.879119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:16.879119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:16.879119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:16.879119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:16.879119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:16.879119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:16.879119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:16.879119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:16.879119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:16.879119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:16.879119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:16.879119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:16.879119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:16.879119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:16.879119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:16.880112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:16.880112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:16.880112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:16.880112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:16.880112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:16.880112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:16.880112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:16.880112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:16.880112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:16.880112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:16.880112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:16.880112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:16.880112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 166/326] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:11:16.883232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5eea30db-441e-46af-b212-29f8ca2aa55f None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:16.884485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5eea30db-441e-46af-b212-29f8ca2aa55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:16.887957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433db32-a113-4095-8c11-b046c6eae3a2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:16.994599 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 161/327] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:17.068317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433db32-a113-4095-8c11-b046c6eae3a2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:17.111557 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:17.132071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab135d-c8c4-489c-9867-d3dd7d64a493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:17.132840 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab135d-c8c4-489c-9867-d3dd7d64a493 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:17.133319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab135d-c8c4-489c-9867-d3dd7d64a493 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:17.133770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab135d-c8c4-489c-9867-d3dd7d64a493 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:17.134968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab135d-c8c4-489c-9867-d3dd7d64a493 None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:17.135470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab135d-c8c4-489c-9867-d3dd7d64a493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:17.137925 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab135d-c8c4-489c-9867-d3dd7d64a493 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:17.151644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 167/328] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:11:16 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:17.157938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea30db-441e-46af-b212-29f8ca2aa55f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:17.296986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab135d-c8c4-489c-9867-d3dd7d64a493 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:17.332583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea30db-441e-46af-b212-29f8ca2aa55f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:17.361152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:17.391852 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8aa50-5611-4364-a9cb-57c9459ab96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:17.392398 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8aa50-5611-4364-a9cb-57c9459ab96f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:17.392740 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8aa50-5611-4364-a9cb-57c9459ab96f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:17.393147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8aa50-5611-4364-a9cb-57c9459ab96f None admin] PATH_INFO: `/v3/users/a6d67b0deb22489c9c5fda8e22afa9bb` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:17.394186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8aa50-5611-4364-a9cb-57c9459ab96f None admin] RBAC: Authorizing `identity:get_user(user_id=a6d67b0deb22489c9c5fda8e22afa9bb)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:17.395685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8aa50-5611-4364-a9cb-57c9459ab96f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:17.397989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 162/329] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:11:17 2022] GET /identity/v3/users/a6d67b0deb22489c9c5fda8e22afa9bb => generated 294 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:17.404649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8aa50-5611-4364-a9cb-57c9459ab96f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:17.467850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab135d-c8c4-489c-9867-d3dd7d64a493 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:17.536567 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067ed8c-14cf-4972-82d0-7785ade2c1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:17.538751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067ed8c-14cf-4972-82d0-7785ade2c1fc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:17.539002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067ed8c-14cf-4972-82d0-7785ade2c1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:17.539295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067ed8c-14cf-4972-82d0-7785ade2c1fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:17.563054 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067ed8c-14cf-4972-82d0-7785ade2c1fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:17.563246 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8aa50-5611-4364-a9cb-57c9459ab96f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:17.571061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d067ed8c-14cf-4972-82d0-7785ade2c1fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:11:17.571061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:17.571061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:17.571061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:17.571061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:17.571061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:17.571061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:17.571061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:17.571061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:17.571061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:17.571061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:17.571061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:17.571061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:17.571061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:17.571061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:17.571061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:17.573164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:17.573164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:17.573164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:17.573164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:17.573164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:17.573164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:17.573164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:17.573164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:17.573164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:17.573164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:17.573164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:17.573164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:17.573164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:17.573164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:17.573164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:17.573164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:17.574994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:17.574994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:17.574994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:17.574994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:17.574994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:17.574994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:17.574994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:17.574994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:17.574994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:17.574994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:17.574994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:11:17.574994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:17.574994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 168/330] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:17.586338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067ed8c-14cf-4972-82d0-7785ade2c1fc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:17.630128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48661d5f-d55a-4da3-a509-4ea23b12c0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:17.631889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48661d5f-d55a-4da3-a509-4ea23b12c0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:17.632717 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48661d5f-d55a-4da3-a509-4ea23b12c0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:17.633324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48661d5f-d55a-4da3-a509-4ea23b12c0d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:17.634346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48661d5f-d55a-4da3-a509-4ea23b12c0d1 None admin] RBAC: Adding query filter params (role.id=6be1975947cd4b948b86c73132244927, user.id=a6d67b0deb22489c9c5fda8e22afa9bb, scope.system=all) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:17.634958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48661d5f-d55a-4da3-a509-4ea23b12c0d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:17.637049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48661d5f-d55a-4da3-a509-4ea23b12c0d1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:17.659089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 163/331] 10.222.0.107 () {56 vars in 1313 bytes} [Tue Aug 23 23:11:17 2022] GET /identity/v3/role_assignments?user.id=a6d67b0deb22489c9c5fda8e22afa9bb&scope.system=all&role.id=6be1975947cd4b948b86c73132244927 => generated 512 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:17.682723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:17.777586 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067ed8c-14cf-4972-82d0-7785ade2c1fc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:17.820736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb73f0d-e60d-458d-81ee-960d3e5930d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:17.821382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb73f0d-e60d-458d-81ee-960d3e5930d8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:17.821663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb73f0d-e60d-458d-81ee-960d3e5930d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:17.821936 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb73f0d-e60d-458d-81ee-960d3e5930d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:17.822633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb73f0d-e60d-458d-81ee-960d3e5930d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:17.822938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb73f0d-e60d-458d-81ee-960d3e5930d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:17.824360 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb73f0d-e60d-458d-81ee-960d3e5930d8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:17.835004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 169/332] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:11:17 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:17.840863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48661d5f-d55a-4da3-a509-4ea23b12c0d1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:17.908088 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:17.983521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48661d5f-d55a-4da3-a509-4ea23b12c0d1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:18.032477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de47dc-d341-4b67-88a5-efcc0d709c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:18.033236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de47dc-d341-4b67-88a5-efcc0d709c86 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:18.033517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de47dc-d341-4b67-88a5-efcc0d709c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:18.033788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de47dc-d341-4b67-88a5-efcc0d709c86 None admin] PATH_INFO: `/v3/users/59d84674aba14d6baefc53afa60420b3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:18.034960 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de47dc-d341-4b67-88a5-efcc0d709c86 None admin] RBAC: Authorizing `identity:get_user(user_id=59d84674aba14d6baefc53afa60420b3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:18.036492 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de47dc-d341-4b67-88a5-efcc0d709c86 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:18.039368 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 164/333] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:11:17 2022] GET /identity/v3/users/59d84674aba14d6baefc53afa60420b3 => generated 294 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:18.046668 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb73f0d-e60d-458d-81ee-960d3e5930d8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:18.175693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb73f0d-e60d-458d-81ee-960d3e5930d8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:18.184461 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:18.217370 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1981d-82d6-43d9-b853-2aed087efb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:18.218043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1981d-82d6-43d9-b853-2aed087efb36 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:18.218320 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1981d-82d6-43d9-b853-2aed087efb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:18.218591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1981d-82d6-43d9-b853-2aed087efb36 None admin] PATH_INFO: `/v3/system/users/59d84674aba14d6baefc53afa60420b3/roles/3d0598848b8f4a18917b5dbb657caa63` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:18.220071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1981d-82d6-43d9-b853-2aed087efb36 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=59d84674aba14d6baefc53afa60420b3, role_id=3d0598848b8f4a18917b5dbb657caa63)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:18.221540 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1981d-82d6-43d9-b853-2aed087efb36 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:18.237977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 170/334] 10.222.0.107 () {58 vars in 1339 bytes} [Tue Aug 23 23:11:18 2022] PUT /identity/v3/system/users/59d84674aba14d6baefc53afa60420b3/roles/3d0598848b8f4a18917b5dbb657caa63 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:19.585864 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3071e-ed21-44ff-8a01-7ebed8f2a0e9 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:19.586403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3071e-ed21-44ff-8a01-7ebed8f2a0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:19.586692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3071e-ed21-44ff-8a01-7ebed8f2a0e9 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:19.588472 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 165/335] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:19.605244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a31b5-62ab-4568-b7eb-e55450931066 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:19.605752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a31b5-62ab-4568-b7eb-e55450931066 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:19.605826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a31b5-62ab-4568-b7eb-e55450931066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:19.634342 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-997a31b5-62ab-4568-b7eb-e55450931066 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:19.636059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-997a31b5-62ab-4568-b7eb-e55450931066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:19.699943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9f4eb-af77-4c7b-8cee-0ce156b44c27 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:19.700369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9f4eb-af77-4c7b-8cee-0ce156b44c27 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:19.700518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9f4eb-af77-4c7b-8cee-0ce156b44c27 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:19.702116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 166/336] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:19.713786 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fdd35-a056-4b52-8ab5-380705cbd2fe None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:19.714157 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fdd35-a056-4b52-8ab5-380705cbd2fe None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:19.714324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fdd35-a056-4b52-8ab5-380705cbd2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:19.732796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 171/337] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:19.752806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a11fdd35-a056-4b52-8ab5-380705cbd2fe None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:19.754019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a11fdd35-a056-4b52-8ab5-380705cbd2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:19.854979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 167/338] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:20.033396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a31b5-62ab-4568-b7eb-e55450931066 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:20.165687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:20.169438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a31b5-62ab-4568-b7eb-e55450931066 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:20.212543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e74a36-5483-44f9-a72f-c53dfd730a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:20.213230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e74a36-5483-44f9-a72f-c53dfd730a52 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:20.213496 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e74a36-5483-44f9-a72f-c53dfd730a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:20.213766 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e74a36-5483-44f9-a72f-c53dfd730a52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:20.228821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e74a36-5483-44f9-a72f-c53dfd730a52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:20.236141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-b5e74a36-5483-44f9-a72f-c53dfd730a52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:20.236141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:20.236141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:20.236141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:20.236141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:20.236141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:20.236141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:20.236141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:20.236141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:20.236141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:20.236141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:20.236141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:20.236141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:20.236141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:20.236141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:20.236141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:20.237096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:20.237096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:20.237096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:20.237096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:20.237096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:20.237096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:20.237096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:20.237096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:20.237096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:20.237096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:20.237096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:20.237096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:20.237096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:20.237096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:20.237096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:20.237096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:20.237886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:20.237886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:20.237886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:20.237886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:20.237886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:20.237886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:20.237886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:20.237886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:20.237886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:20.237886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:20.237886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:20.237886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:20.237886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 172/339] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:20.244687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fdd35-a056-4b52-8ab5-380705cbd2fe None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:20.286892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e74a36-5483-44f9-a72f-c53dfd730a52 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:20.347509 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:20.476845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fdd35-a056-4b52-8ab5-380705cbd2fe None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:20.487590 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e74a36-5483-44f9-a72f-c53dfd730a52 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:20.525572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4dd4f-46bb-4371-a67e-72ffe5b6e4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:20.526216 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4dd4f-46bb-4371-a67e-72ffe5b6e4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:20.526489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4dd4f-46bb-4371-a67e-72ffe5b6e4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:20.526759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4dd4f-46bb-4371-a67e-72ffe5b6e4c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:20.541043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4dd4f-46bb-4371-a67e-72ffe5b6e4c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:20.548622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a6f4dd4f-46bb-4371-a67e-72ffe5b6e4c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:20.548622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:20.548622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:20.548622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:20.548622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:20.548622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:20.548622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:20.548622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:20.548622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:20.548622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:20.548622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:20.548622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:20.548622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:20.548622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:20.548622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:20.548622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:20.549559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:20.549559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:20.549559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:20.549559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:20.549559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:20.549559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:20.549559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:20.549559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:20.549559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:20.549559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:20.549559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:20.549559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:20.549559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:20.549559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:20.549559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:20.549559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:20.550385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:20.550385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:20.550385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:20.550385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:20.550385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:20.550385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:20.550385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:20.550385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:20.550385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:20.550385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:20.550385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:20.550385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:20.550385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 173/340] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:11:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:11:20.554276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4dd4f-46bb-4371-a67e-72ffe5b6e4c4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:20.556043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ef2c7-570a-46e7-8971-12bf1f40611e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:20.556925 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ef2c7-570a-46e7-8971-12bf1f40611e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:20.557533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ef2c7-570a-46e7-8971-12bf1f40611e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:20.558020 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ef2c7-570a-46e7-8971-12bf1f40611e None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:20.558973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ef2c7-570a-46e7-8971-12bf1f40611e None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:20.559477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ef2c7-570a-46e7-8971-12bf1f40611e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:20.561101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ef2c7-570a-46e7-8971-12bf1f40611e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:20.576120 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 168/341] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:11:20 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:20.579172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:20.581691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ef2c7-570a-46e7-8971-12bf1f40611e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:20.676148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4dd4f-46bb-4371-a67e-72ffe5b6e4c4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:20.719353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93c03d-6f2f-49d3-a297-ffb287c54e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:20.720225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93c03d-6f2f-49d3-a297-ffb287c54e28 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:20.720668 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93c03d-6f2f-49d3-a297-ffb287c54e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:20.721379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93c03d-6f2f-49d3-a297-ffb287c54e28 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:20.722203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93c03d-6f2f-49d3-a297-ffb287c54e28 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:20.722659 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93c03d-6f2f-49d3-a297-ffb287c54e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:20.725981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93c03d-6f2f-49d3-a297-ffb287c54e28 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:20.741340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 174/342] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:20 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:20.744762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93c03d-6f2f-49d3-a297-ffb287c54e28 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:20.794604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ef2c7-570a-46e7-8971-12bf1f40611e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:20.796620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:20.854872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:20.878324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93c03d-6f2f-49d3-a297-ffb287c54e28 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:20.882113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346ee6e-7c6c-434f-91df-e83e8f66b372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:20.883256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346ee6e-7c6c-434f-91df-e83e8f66b372 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:20.883743 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346ee6e-7c6c-434f-91df-e83e8f66b372 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:20.884203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346ee6e-7c6c-434f-91df-e83e8f66b372 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:20.921195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f99d2-28f9-4330-a365-3227daef34e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:20.922601 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f99d2-28f9-4330-a365-3227daef34e0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:20.923049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f99d2-28f9-4330-a365-3227daef34e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:20.923458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f99d2-28f9-4330-a365-3227daef34e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:21.054847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346ee6e-7c6c-434f-91df-e83e8f66b372 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:21.057539 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346ee6e-7c6c-434f-91df-e83e8f66b372 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:21.092626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f99d2-28f9-4330-a365-3227daef34e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:21.092626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f99d2-28f9-4330-a365-3227daef34e0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:21.210989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:21.220788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 169/343] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:20 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:21.231469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346ee6e-7c6c-434f-91df-e83e8f66b372 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:21.241589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:21.263732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 175/344] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:20 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:11:21.269704 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f99d2-28f9-4330-a365-3227daef34e0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:21.419293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f99d2-28f9-4330-a365-3227daef34e0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:21.434675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346ee6e-7c6c-434f-91df-e83e8f66b372 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:21.472565 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8a658-c7c6-4c13-ab79-6e8edae4f532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:21.473357 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8a658-c7c6-4c13-ab79-6e8edae4f532 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:21.473636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8a658-c7c6-4c13-ab79-6e8edae4f532 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:21.473909 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8a658-c7c6-4c13-ab79-6e8edae4f532 None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:21.476742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8a658-c7c6-4c13-ab79-6e8edae4f532 None admin] RBAC: Authorizing `identity:get_project(project_id=7cf2243c0cdc44da93063ff4af6a2330)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:21.477630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8a658-c7c6-4c13-ab79-6e8edae4f532 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:21.479482 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 176/345] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:21 2022] GET /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330 => generated 299 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:21.480687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae1b05-c77b-4c89-9996-a021ee9ed179 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:21.480868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae1b05-c77b-4c89-9996-a021ee9ed179 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:21.481110 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae1b05-c77b-4c89-9996-a021ee9ed179 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:21.482500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 177/346] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:21.488214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546b88c-265d-4901-835e-e55723570bed None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:21.488548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546b88c-265d-4901-835e-e55723570bed None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:21.488806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546b88c-265d-4901-835e-e55723570bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:21.490198 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf5234-9287-486a-90f2-666c78b3d113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:21.491824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf5234-9287-486a-90f2-666c78b3d113 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:21.492674 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf5234-9287-486a-90f2-666c78b3d113 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:21.493256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf5234-9287-486a-90f2-666c78b3d113 None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:21.494811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf5234-9287-486a-90f2-666c78b3d113 None admin] RBAC: Authorizing `identity:get_project(project_id=7cf2243c0cdc44da93063ff4af6a2330)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:21.497708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf5234-9287-486a-90f2-666c78b3d113 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:21.500136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 170/347] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:21 2022] GET /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330 => generated 299 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:21.501218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf5234-9287-486a-90f2-666c78b3d113 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:21.509669 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f546b88c-265d-4901-835e-e55723570bed None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:21.510897 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f546b88c-265d-4901-835e-e55723570bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:21.570803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:21.597184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 178/348] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:21.598122 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546b88c-265d-4901-835e-e55723570bed None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:21.602410 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:21.643945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf5234-9287-486a-90f2-666c78b3d113 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:21.689352 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca7a74-b9c4-4869-ad1d-555ecd2839c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:21.690341 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca7a74-b9c4-4869-ad1d-555ecd2839c7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:21.690814 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca7a74-b9c4-4869-ad1d-555ecd2839c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:21.691317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca7a74-b9c4-4869-ad1d-555ecd2839c7 None admin] PATH_INFO: `/v3/groups/6377dcd6769240f7b51185157ee7b2ab` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:21.700051 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca7a74-b9c4-4869-ad1d-555ecd2839c7 None admin] RBAC: Authorizing `identity:get_group(group_id=6377dcd6769240f7b51185157ee7b2ab)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:21.702051 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca7a74-b9c4-4869-ad1d-555ecd2839c7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:21.705089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 171/349] 10.222.0.107 () {56 vars in 1185 bytes} [Tue Aug 23 23:11:21 2022] GET /identity/v3/groups/6377dcd6769240f7b51185157ee7b2ab => generated 227 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:21.716750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca7a74-b9c4-4869-ad1d-555ecd2839c7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:21.846694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546b88c-265d-4901-835e-e55723570bed None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:21.852813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca7a74-b9c4-4869-ad1d-555ecd2839c7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:21.901058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5b700-77a3-4af9-9514-dbe209e0d26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:21.901711 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5b700-77a3-4af9-9514-dbe209e0d26c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:21.902027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5b700-77a3-4af9-9514-dbe209e0d26c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:21.902296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5b700-77a3-4af9-9514-dbe209e0d26c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:21.903029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5b700-77a3-4af9-9514-dbe209e0d26c None admin] RBAC: Adding query filter params (group.id=6377dcd6769240f7b51185157ee7b2ab, role.id=8801d305c8374d34abe896d3b7685174, scope.project.id=7cf2243c0cdc44da93063ff4af6a2330) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:21.903329 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5b700-77a3-4af9-9514-dbe209e0d26c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:21.904945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5b700-77a3-4af9-9514-dbe209e0d26c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:21.907923 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:21.917250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 172/350] 10.222.0.107 () {56 vars in 1381 bytes} [Tue Aug 23 23:11:21 2022] GET /identity/v3/role_assignments?group.id=6377dcd6769240f7b51185157ee7b2ab&scope.project.id=7cf2243c0cdc44da93063ff4af6a2330&role.id=8801d305c8374d34abe896d3b7685174 => generated 261 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:21.918618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5edac3-bd6d-478a-a4b0-e142c26fe385 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:21.918968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5edac3-bd6d-478a-a4b0-e142c26fe385 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:21.919249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5edac3-bd6d-478a-a4b0-e142c26fe385 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:21.919896 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f46c4-efcd-49d1-8af6-8b05ed361caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:21.920552 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 173/351] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:21.921109 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f46c4-efcd-49d1-8af6-8b05ed361caa None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:21.921584 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f46c4-efcd-49d1-8af6-8b05ed361caa None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:21.921714 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb27db3-a7fa-4851-a1b2-180129beb8dd None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:21.922157 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb27db3-a7fa-4851-a1b2-180129beb8dd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:21.922302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f46c4-efcd-49d1-8af6-8b05ed361caa None admin] PATH_INFO: `/v3/groups/6377dcd6769240f7b51185157ee7b2ab` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:21.922699 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb27db3-a7fa-4851-a1b2-180129beb8dd None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:21.923804 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f46c4-efcd-49d1-8af6-8b05ed361caa None admin] RBAC: Authorizing `identity:get_group(group_id=6377dcd6769240f7b51185157ee7b2ab)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:21.924548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 174/352] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:21.927354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21a53d-7bad-45e7-a7c9-86a28242deef None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:21.927863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21a53d-7bad-45e7-a7c9-86a28242deef None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:21.928314 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21a53d-7bad-45e7-a7c9-86a28242deef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:21.930226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f46c4-efcd-49d1-8af6-8b05ed361caa None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:21.932223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 179/353] 10.222.0.107 () {56 vars in 1185 bytes} [Tue Aug 23 23:11:21 2022] GET /identity/v3/groups/6377dcd6769240f7b51185157ee7b2ab => generated 227 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:21.934192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d0306-ca61-4015-97ef-e107d1329bd6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:21.934778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d0306-ca61-4015-97ef-e107d1329bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:21.935286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d0306-ca61-4015-97ef-e107d1329bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:21.958491 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6a5d0306-ca61-4015-97ef-e107d1329bd6 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:21.960913 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6a5d0306-ca61-4015-97ef-e107d1329bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:21.963249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9e21a53d-7bad-45e7-a7c9-86a28242deef None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:21.965142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9e21a53d-7bad-45e7-a7c9-86a28242deef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:22.039519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:22.085152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 180/354] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:22.086912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d0306-ca61-4015-97ef-e107d1329bd6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:22.099747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 175/355] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:22.101020 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21a53d-7bad-45e7-a7c9-86a28242deef None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:22.219356 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21a53d-7bad-45e7-a7c9-86a28242deef None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:22.251266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:22.260138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f3b16-4613-4fcc-af5a-1d437fcc0cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:22.261078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f3b16-4613-4fcc-af5a-1d437fcc0cdb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:22.261529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f3b16-4613-4fcc-af5a-1d437fcc0cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:22.262122 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f3b16-4613-4fcc-af5a-1d437fcc0cdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:22.275480 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f3b16-4613-4fcc-af5a-1d437fcc0cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:22.280881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-810f3b16-4613-4fcc-af5a-1d437fcc0cdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:22.280881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:22.280881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:22.280881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:22.280881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:22.280881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:22.280881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:22.280881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:22.280881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:22.280881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:22.280881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:22.280881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:22.280881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:22.280881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:22.280881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:22.280881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:22.281984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:22.281984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:22.281984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:22.281984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:22.281984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:22.281984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:22.281984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:22.281984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:22.281984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:22.281984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:22.281984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:22.281984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:22.281984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:22.281984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:22.281984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:22.281984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:22.283025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:22.283025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:22.283025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:22.283025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:22.283025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:22.283025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:22.283025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:22.283025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:22.283025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:22.283025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:22.283025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:22.283025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:22.285056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 176/356] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:22.292009 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f3b16-4613-4fcc-af5a-1d437fcc0cdb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:22.412096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f3b16-4613-4fcc-af5a-1d437fcc0cdb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:22.421207 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d0306-ca61-4015-97ef-e107d1329bd6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:22.461414 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf36123-f48a-4c79-bda4-5423708c40aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:22.462044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf36123-f48a-4c79-bda4-5423708c40aa None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:22.462323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf36123-f48a-4c79-bda4-5423708c40aa None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:22.462598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf36123-f48a-4c79-bda4-5423708c40aa None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:22.463350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf36123-f48a-4c79-bda4-5423708c40aa None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:22.463658 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf36123-f48a-4c79-bda4-5423708c40aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:22.465091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf36123-f48a-4c79-bda4-5423708c40aa None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:22.476994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 177/357] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:11:22 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:22.477922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf36123-f48a-4c79-bda4-5423708c40aa None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:22.489807 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4a930-d58c-416e-95d9-5ace991d45f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:22.491962 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4a930-d58c-416e-95d9-5ace991d45f0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:22.492247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4a930-d58c-416e-95d9-5ace991d45f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:22.492519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4a930-d58c-416e-95d9-5ace991d45f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:22.493349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4a930-d58c-416e-95d9-5ace991d45f0 None admin] RBAC: Adding query filter params (group.id=6377dcd6769240f7b51185157ee7b2ab, role.id=6be1975947cd4b948b86c73132244927, scope.project.id=7cf2243c0cdc44da93063ff4af6a2330) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:22.493660 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4a930-d58c-416e-95d9-5ace991d45f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:22.495109 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4a930-d58c-416e-95d9-5ace991d45f0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:22.503258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 181/358] 10.222.0.107 () {56 vars in 1381 bytes} [Tue Aug 23 23:11:22 2022] GET /identity/v3/role_assignments?group.id=6377dcd6769240f7b51185157ee7b2ab&scope.project.id=7cf2243c0cdc44da93063ff4af6a2330&role.id=6be1975947cd4b948b86c73132244927 => generated 261 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:22.505385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4a427-9a2b-404c-be16-92d29a7ecb3b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:22.505845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4a427-9a2b-404c-be16-92d29a7ecb3b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:22.507038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4a427-9a2b-404c-be16-92d29a7ecb3b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:22.509641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 182/359] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:22 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:22.511007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4a427-9a2b-404c-be16-92d29a7ecb3b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:22.548682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:22.581168 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:22.667905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4a427-9a2b-404c-be16-92d29a7ecb3b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:22.676095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf36123-f48a-4c79-bda4-5423708c40aa None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:22.731090 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911c80e-c454-4953-a6f8-ef7806f14003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:22.731725 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911c80e-c454-4953-a6f8-ef7806f14003 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:22.732005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911c80e-c454-4953-a6f8-ef7806f14003 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:22.732277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911c80e-c454-4953-a6f8-ef7806f14003 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:22.736641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053e032-d5f8-4ef8-b58a-0a1eda2e9c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:22.738863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053e032-d5f8-4ef8-b58a-0a1eda2e9c53 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:22.739564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053e032-d5f8-4ef8-b58a-0a1eda2e9c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:22.740250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053e032-d5f8-4ef8-b58a-0a1eda2e9c53 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:22.764341 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053e032-d5f8-4ef8-b58a-0a1eda2e9c53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:22.773957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-a053e032-d5f8-4ef8-b58a-0a1eda2e9c53 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:11:22.773957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:22.773957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:22.773957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:22.773957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:22.773957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:22.773957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:22.773957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:22.773957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:22.773957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:22.773957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:22.773957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:22.773957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:22.773957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:22.773957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:22.773957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:22.775103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:22.775103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:22.775103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:22.775103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:22.775103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:22.775103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:22.775103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:22.775103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:22.775103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:22.775103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:22.775103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:22.775103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:22.775103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:22.775103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:22.775103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:22.775103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:22.775981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:22.775981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:22.775981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:22.775981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:22.775981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:22.775981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:22.775981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:22.775981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:22.775981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:22.775981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:22.775981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:11:22.775981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:22.782731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 178/360] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:22.782731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f8211-74f7-43f5-b63a-4a5d5cb12aac None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:22.782731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f8211-74f7-43f5-b63a-4a5d5cb12aac None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:22.782731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f8211-74f7-43f5-b63a-4a5d5cb12aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:22.807358 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-816f8211-74f7-43f5-b63a-4a5d5cb12aac None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:22.808836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-816f8211-74f7-43f5-b63a-4a5d5cb12aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:22.843909 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911c80e-c454-4953-a6f8-ef7806f14003 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:22.845554 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911c80e-c454-4953-a6f8-ef7806f14003 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:22.891412 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 179/361] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:22.892832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f8211-74f7-43f5-b63a-4a5d5cb12aac None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:22.896926 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:22.951082 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:22.987580 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 183/362] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:22.993059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911c80e-c454-4953-a6f8-ef7806f14003 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:23.031435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f8211-74f7-43f5-b63a-4a5d5cb12aac None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:23.083646 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4dcdf-ec4f-41bc-83f5-e75db02256dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:23.084934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4dcdf-ec4f-41bc-83f5-e75db02256dc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:23.086043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4dcdf-ec4f-41bc-83f5-e75db02256dc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:23.086455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4dcdf-ec4f-41bc-83f5-e75db02256dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:23.105415 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4dcdf-ec4f-41bc-83f5-e75db02256dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:23.110477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-bff4dcdf-ec4f-41bc-83f5-e75db02256dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:23.110477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:23.110477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:23.110477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:23.110477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:23.110477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:23.110477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:23.110477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:23.110477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:23.110477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:23.110477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:23.110477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:23.110477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:23.110477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:23.110477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:23.110477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:23.112187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:23.112187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:23.112187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:23.112187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:23.112187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:23.112187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:23.112187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:23.112187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:23.112187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:23.112187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:23.112187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:23.112187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:23.112187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:23.112187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:23.112187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:23.112187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:23.114365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:23.114365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:23.114365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:23.114365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:23.114365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:23.114365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:23.114365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:23.114365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:23.114365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:23.114365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:23.114365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:23.114365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:23.114365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 180/363] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:11:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:23.121116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4dcdf-ec4f-41bc-83f5-e75db02256dc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:23.268483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911c80e-c454-4953-a6f8-ef7806f14003 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:23.297026 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:23.300418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4dcdf-ec4f-41bc-83f5-e75db02256dc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:23.347183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9229e-d7e0-45a4-9192-759813ae219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:23.347939 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9229e-d7e0-45a4-9192-759813ae219e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:23.348225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9229e-d7e0-45a4-9192-759813ae219e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:23.348872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9229e-d7e0-45a4-9192-759813ae219e None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:23.349638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9229e-d7e0-45a4-9192-759813ae219e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:23.350028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9229e-d7e0-45a4-9192-759813ae219e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:23.352080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9229e-d7e0-45a4-9192-759813ae219e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:23.362275 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567a5b0-630a-4a9e-b2d7-f23a84fa1711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:23.363162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567a5b0-630a-4a9e-b2d7-f23a84fa1711 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:23.363647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567a5b0-630a-4a9e-b2d7-f23a84fa1711 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:23.364042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567a5b0-630a-4a9e-b2d7-f23a84fa1711 None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:23.366669 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567a5b0-630a-4a9e-b2d7-f23a84fa1711 None admin] RBAC: Authorizing `identity:get_project(project_id=c75a8d1aa0614b1aa01db2d404827c77)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:23.370183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567a5b0-630a-4a9e-b2d7-f23a84fa1711 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:23.372816 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 184/365] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:11:22 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:23.373106 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 181/365] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:23 2022] GET /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77 => generated 303 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:23.373780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9229e-d7e0-45a4-9192-759813ae219e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:23.379017 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567a5b0-630a-4a9e-b2d7-f23a84fa1711 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:23.389871 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:23.596137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567a5b0-630a-4a9e-b2d7-f23a84fa1711 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:23.624799 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9229e-d7e0-45a4-9192-759813ae219e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:23.653132 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ef97a-7c5c-44ef-ae56-5102c9a6e7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:23.653887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ef97a-7c5c-44ef-ae56-5102c9a6e7cd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:23.654328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ef97a-7c5c-44ef-ae56-5102c9a6e7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:23.654755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ef97a-7c5c-44ef-ae56-5102c9a6e7cd None admin] PATH_INFO: `/v3/groups/6377dcd6769240f7b51185157ee7b2ab` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:23.656690 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ef97a-7c5c-44ef-ae56-5102c9a6e7cd None admin] RBAC: Authorizing `identity:get_group(group_id=6377dcd6769240f7b51185157ee7b2ab)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:23.658454 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ef97a-7c5c-44ef-ae56-5102c9a6e7cd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:23.660422 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 182/366] 10.222.0.107 () {56 vars in 1185 bytes} [Tue Aug 23 23:11:23 2022] GET /identity/v3/groups/6377dcd6769240f7b51185157ee7b2ab => generated 227 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:23.661698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ef97a-7c5c-44ef-ae56-5102c9a6e7cd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:23.685078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130984a0-7490-4f2b-8d65-9d50534ed7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:23.685728 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130984a0-7490-4f2b-8d65-9d50534ed7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:23.686015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130984a0-7490-4f2b-8d65-9d50534ed7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:23.686283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130984a0-7490-4f2b-8d65-9d50534ed7b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:23.687707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130984a0-7490-4f2b-8d65-9d50534ed7b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:23.688020 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130984a0-7490-4f2b-8d65-9d50534ed7b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:23.689938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130984a0-7490-4f2b-8d65-9d50534ed7b9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:23.703159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 185/367] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:23 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:23.704192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130984a0-7490-4f2b-8d65-9d50534ed7b9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:23.719428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:23.809498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:23.833935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ef97a-7c5c-44ef-ae56-5102c9a6e7cd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:23.863866 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130984a0-7490-4f2b-8d65-9d50534ed7b9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:23.911240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbce7d-56c5-418e-b4c2-1dad04ac5878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:23.913378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbce7d-56c5-418e-b4c2-1dad04ac5878 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:23.914021 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd572b-4c40-4334-90c3-1bf9b973be66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:23.914821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd572b-4c40-4334-90c3-1bf9b973be66 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:23.915050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbce7d-56c5-418e-b4c2-1dad04ac5878 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:23.915295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd572b-4c40-4334-90c3-1bf9b973be66 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:23.915667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd572b-4c40-4334-90c3-1bf9b973be66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:23.915975 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbce7d-56c5-418e-b4c2-1dad04ac5878 None admin] PATH_INFO: `/v3/users/59d84674aba14d6baefc53afa60420b3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:23.918694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbce7d-56c5-418e-b4c2-1dad04ac5878 None admin] RBAC: Authorizing `identity:get_user(user_id=59d84674aba14d6baefc53afa60420b3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:23.920910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbce7d-56c5-418e-b4c2-1dad04ac5878 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:23.924386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 183/368] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:11:23 2022] GET /identity/v3/users/59d84674aba14d6baefc53afa60420b3 => generated 294 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:23.925883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbce7d-56c5-418e-b4c2-1dad04ac5878 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:23.935545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd572b-4c40-4334-90c3-1bf9b973be66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:23.944731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-58cd572b-4c40-4334-90c3-1bf9b973be66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:23.944731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:23.944731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:23.944731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:23.944731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:23.944731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:23.944731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:23.944731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:23.944731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:23.944731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:23.944731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:23.944731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:23.944731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:23.944731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:23.944731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:23.944731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:23.946489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:23.946489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:23.946489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:23.946489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:23.946489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:23.946489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:23.946489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:23.946489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:23.946489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:23.946489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:23.946489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:23.946489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:23.946489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:23.946489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:23.946489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:23.946489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:23.948175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:23.948175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:23.948175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:23.948175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:23.948175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:23.948175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:23.948175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:23.948175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:23.948175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:23.948175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:23.948175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:23.948175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:23.951775 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 186/369] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:11:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:23.956988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd572b-4c40-4334-90c3-1bf9b973be66 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:24.094531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbce7d-56c5-418e-b4c2-1dad04ac5878 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:24.097884 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:24.122605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd572b-4c40-4334-90c3-1bf9b973be66 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:24.147512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f136c-1a1e-49e5-8203-91f0bb5894f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:24.148163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f136c-1a1e-49e5-8203-91f0bb5894f0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:24.148444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f136c-1a1e-49e5-8203-91f0bb5894f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:24.148774 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f136c-1a1e-49e5-8203-91f0bb5894f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:24.149968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f136c-1a1e-49e5-8203-91f0bb5894f0 None admin] RBAC: Adding query filter params (group.id=6377dcd6769240f7b51185157ee7b2ab, role.id=6be1975947cd4b948b86c73132244927, scope.project.id=c75a8d1aa0614b1aa01db2d404827c77) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:24.150283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f136c-1a1e-49e5-8203-91f0bb5894f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:24.153497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f136c-1a1e-49e5-8203-91f0bb5894f0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:24.160692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 184/370] 10.222.0.107 () {56 vars in 1381 bytes} [Tue Aug 23 23:11:23 2022] GET /identity/v3/role_assignments?group.id=6377dcd6769240f7b51185157ee7b2ab&scope.project.id=c75a8d1aa0614b1aa01db2d404827c77&role.id=6be1975947cd4b948b86c73132244927 => generated 261 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:24.165240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f136c-1a1e-49e5-8203-91f0bb5894f0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:24.172918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:24.185724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481b6ed-9682-4d10-b09f-0200e3144c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:24.186659 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481b6ed-9682-4d10-b09f-0200e3144c9f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:24.187035 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481b6ed-9682-4d10-b09f-0200e3144c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:24.187407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481b6ed-9682-4d10-b09f-0200e3144c9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:24.285454 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481b6ed-9682-4d10-b09f-0200e3144c9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:24.288231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481b6ed-9682-4d10-b09f-0200e3144c9f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:24.326076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f136c-1a1e-49e5-8203-91f0bb5894f0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:24.390238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638087e-d701-4289-be3b-26489bc718c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:24.391156 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638087e-d701-4289-be3b-26489bc718c1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:24.391615 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638087e-d701-4289-be3b-26489bc718c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:24.392150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638087e-d701-4289-be3b-26489bc718c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:24.393140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638087e-d701-4289-be3b-26489bc718c1 None admin] RBAC: Adding query filter params (role.id=3d0598848b8f4a18917b5dbb657caa63, user.id=59d84674aba14d6baefc53afa60420b3, scope.system=all) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:24.393641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638087e-d701-4289-be3b-26489bc718c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:24.395388 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638087e-d701-4289-be3b-26489bc718c1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:24.409986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 185/371] 10.222.0.107 () {56 vars in 1313 bytes} [Tue Aug 23 23:11:24 2022] GET /identity/v3/role_assignments?user.id=59d84674aba14d6baefc53afa60420b3&scope.system=all&role.id=3d0598848b8f4a18917b5dbb657caa63 => generated 512 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:24.412101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638087e-d701-4289-be3b-26489bc718c1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:24.434296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 187/372] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:23 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:24.440171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481b6ed-9682-4d10-b09f-0200e3144c9f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:24.473998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:24.488556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:24.598736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481b6ed-9682-4d10-b09f-0200e3144c9f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:24.627016 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638087e-d701-4289-be3b-26489bc718c1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:24.649639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36433971-7524-42bc-af68-8d2ded503704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:24.650216 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36433971-7524-42bc-af68-8d2ded503704 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:24.651085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36433971-7524-42bc-af68-8d2ded503704 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:24.651358 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36433971-7524-42bc-af68-8d2ded503704 None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:24.652946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36433971-7524-42bc-af68-8d2ded503704 None admin] RBAC: Authorizing `identity:get_project(project_id=c75a8d1aa0614b1aa01db2d404827c77)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:24.654477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36433971-7524-42bc-af68-8d2ded503704 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:24.656804 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 188/373] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:24 2022] GET /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77 => generated 303 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:24.662524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36433971-7524-42bc-af68-8d2ded503704 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:24.702642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bae14-73da-44c2-a3be-fbd396c3d75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:24.703292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bae14-73da-44c2-a3be-fbd396c3d75d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:24.703571 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bae14-73da-44c2-a3be-fbd396c3d75d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:24.703843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bae14-73da-44c2-a3be-fbd396c3d75d None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:24.704554 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bae14-73da-44c2-a3be-fbd396c3d75d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:24.704895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bae14-73da-44c2-a3be-fbd396c3d75d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:24.706342 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bae14-73da-44c2-a3be-fbd396c3d75d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:24.719208 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 186/374] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:24 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:24.724805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bae14-73da-44c2-a3be-fbd396c3d75d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:24.860687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:24.864239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:24.895205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36433971-7524-42bc-af68-8d2ded503704 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:24.914914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bae14-73da-44c2-a3be-fbd396c3d75d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:24.955460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203b293-c494-4d79-b4e5-d9298e2a4709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:24.958328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203b293-c494-4d79-b4e5-d9298e2a4709 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:24.958809 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203b293-c494-4d79-b4e5-d9298e2a4709 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:24.959821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203b293-c494-4d79-b4e5-d9298e2a4709 None admin] PATH_INFO: `/v3/groups/6377dcd6769240f7b51185157ee7b2ab` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:24.964021 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203b293-c494-4d79-b4e5-d9298e2a4709 None admin] RBAC: Authorizing `identity:get_group(group_id=6377dcd6769240f7b51185157ee7b2ab)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:24.969571 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203b293-c494-4d79-b4e5-d9298e2a4709 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:24.975007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 189/375] 10.222.0.107 () {56 vars in 1185 bytes} [Tue Aug 23 23:11:24 2022] GET /identity/v3/groups/6377dcd6769240f7b51185157ee7b2ab => generated 227 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:24.993709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203b293-c494-4d79-b4e5-d9298e2a4709 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:25.033359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a55a9-db6c-42d9-ac21-422dc4b1fed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:25.034084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a55a9-db6c-42d9-ac21-422dc4b1fed6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:25.034356 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a55a9-db6c-42d9-ac21-422dc4b1fed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:25.034627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a55a9-db6c-42d9-ac21-422dc4b1fed6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:25.228378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203b293-c494-4d79-b4e5-d9298e2a4709 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:25.245331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a55a9-db6c-42d9-ac21-422dc4b1fed6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:25.246847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a55a9-db6c-42d9-ac21-422dc4b1fed6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:25.301208 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc8345-b64a-4022-ab4d-f6153433c0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:25.302600 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc8345-b64a-4022-ab4d-f6153433c0de None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:25.303363 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc8345-b64a-4022-ab4d-f6153433c0de None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:25.304276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc8345-b64a-4022-ab4d-f6153433c0de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:25.306444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc8345-b64a-4022-ab4d-f6153433c0de None admin] RBAC: Adding query filter params (group.id=6377dcd6769240f7b51185157ee7b2ab, role.id=8801d305c8374d34abe896d3b7685174, scope.project.id=c75a8d1aa0614b1aa01db2d404827c77) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:25.307270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc8345-b64a-4022-ab4d-f6153433c0de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:25.310420 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc8345-b64a-4022-ab4d-f6153433c0de None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:25.323216 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 190/376] 10.222.0.107 () {56 vars in 1381 bytes} [Tue Aug 23 23:11:24 2022] GET /identity/v3/role_assignments?group.id=6377dcd6769240f7b51185157ee7b2ab&scope.project.id=c75a8d1aa0614b1aa01db2d404827c77&role.id=8801d305c8374d34abe896d3b7685174 => generated 261 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:25.436869 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:25.452487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 187/377] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 728 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:25.462498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc8345-b64a-4022-ab4d-f6153433c0de None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:25.536236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:25.692499 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc8345-b64a-4022-ab4d-f6153433c0de None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:25.759810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2dc9ea-c573-4851-9e57-fbac788feeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:25.760935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dc9ea-c573-4851-9e57-fbac788feeb1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:25.761650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dc9ea-c573-4851-9e57-fbac788feeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:25.762129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dc9ea-c573-4851-9e57-fbac788feeb1 None admin] PATH_INFO: `/v3/projects/2ab98da0af85419a9eb4e9e222c7d0ea` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:25.764584 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dc9ea-c573-4851-9e57-fbac788feeb1 None admin] RBAC: Authorizing `identity:get_project(project_id=2ab98da0af85419a9eb4e9e222c7d0ea)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:25.767404 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dc9ea-c573-4851-9e57-fbac788feeb1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:25.770754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 191/378] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:25 2022] GET /identity/v3/projects/2ab98da0af85419a9eb4e9e222c7d0ea => generated 345 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:25.779822 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a55a9-db6c-42d9-ac21-422dc4b1fed6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:25.800084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3a43b-9d48-4ede-9e8d-d2e1ca64d608 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:25.800084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3a43b-9d48-4ede-9e8d-d2e1ca64d608 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:25.800084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3a43b-9d48-4ede-9e8d-d2e1ca64d608 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:25.800391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 192/379] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:25 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:25.801821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2d0f2-64dc-4bc8-91fe-500947d6b5d1 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:25.802101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2d0f2-64dc-4bc8-91fe-500947d6b5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:25.802370 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2d0f2-64dc-4bc8-91fe-500947d6b5d1 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:25.804314 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 193/380] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:11:25.810169 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958acf3-45b6-4173-93b0-8154e7bb1a53 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:25.810451 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958acf3-45b6-4173-93b0-8154e7bb1a53 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:25.810721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958acf3-45b6-4173-93b0-8154e7bb1a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:25.846550 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2958acf3-45b6-4173-93b0-8154e7bb1a53 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:25.848511 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2958acf3-45b6-4173-93b0-8154e7bb1a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:25.939659 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a55a9-db6c-42d9-ac21-422dc4b1fed6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:25.995771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7eeba-97ec-4de5-bb47-469318d9ead5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:25.996422 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7eeba-97ec-4de5-bb47-469318d9ead5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:25.996715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7eeba-97ec-4de5-bb47-469318d9ead5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:25.996995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7eeba-97ec-4de5-bb47-469318d9ead5 None admin] PATH_INFO: `/v3/groups/42552607c43a49dc9b2a0b446fae60c4` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:26.007524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7eeba-97ec-4de5-bb47-469318d9ead5 None admin] RBAC: Authorizing `identity:get_group(group_id=42552607c43a49dc9b2a0b446fae60c4)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:26.009240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7eeba-97ec-4de5-bb47-469318d9ead5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:26.011459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 188/381] 10.222.0.107 () {56 vars in 1185 bytes} [Tue Aug 23 23:11:25 2022] GET /identity/v3/groups/42552607c43a49dc9b2a0b446fae60c4 => generated 230 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:26.017210 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c3b71-cd56-482f-976b-16bd1478e8d6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:26.017730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c3b71-cd56-482f-976b-16bd1478e8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:26.017846 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c3b71-cd56-482f-976b-16bd1478e8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:26.024063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 194/382] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:26.025606 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958acf3-45b6-4173-93b0-8154e7bb1a53 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:26.043566 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5d0c3b71-cd56-482f-976b-16bd1478e8d6 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:26.053195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5d0c3b71-cd56-482f-976b-16bd1478e8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:26.066355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:26.158846 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:26.209278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958acf3-45b6-4173-93b0-8154e7bb1a53 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:26.222790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 189/383] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:26.270145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528d0e8-2cf6-4853-9f87-af8febb672e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:26.271134 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528d0e8-2cf6-4853-9f87-af8febb672e0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:26.271608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528d0e8-2cf6-4853-9f87-af8febb672e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:26.272856 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528d0e8-2cf6-4853-9f87-af8febb672e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:26.273891 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528d0e8-2cf6-4853-9f87-af8febb672e0 None admin] RBAC: Adding query filter params (group.id=42552607c43a49dc9b2a0b446fae60c4, role.id=97ece22f2e264e0e857d5107325a85d9, scope.project.id=2ab98da0af85419a9eb4e9e222c7d0ea) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:26.274462 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528d0e8-2cf6-4853-9f87-af8febb672e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:26.276121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528d0e8-2cf6-4853-9f87-af8febb672e0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:26.285187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 195/384] 10.222.0.107 () {56 vars in 1381 bytes} [Tue Aug 23 23:11:26 2022] GET /identity/v3/role_assignments?group.id=42552607c43a49dc9b2a0b446fae60c4&scope.project.id=2ab98da0af85419a9eb4e9e222c7d0ea&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 261 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:26.436517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c3b71-cd56-482f-976b-16bd1478e8d6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:26.571360 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c3b71-cd56-482f-976b-16bd1478e8d6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:26.611446 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5b707-8297-4603-914d-4498c2d6250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:26.612097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5b707-8297-4603-914d-4498c2d6250b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:26.612373 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5b707-8297-4603-914d-4498c2d6250b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:26.612739 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5b707-8297-4603-914d-4498c2d6250b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:26.624980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5b707-8297-4603-914d-4498c2d6250b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:26.629839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-77a5b707-8297-4603-914d-4498c2d6250b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:26.629839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:26.629839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:26.629839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:26.629839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:26.629839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:26.629839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:26.629839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:26.629839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:26.629839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:26.629839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:26.629839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:26.629839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:26.629839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:26.629839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:26.629839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:26.630724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:26.630724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:26.630724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:26.630724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:26.630724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:26.630724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:26.630724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:26.630724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:26.630724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:26.630724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:26.630724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:26.630724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:26.630724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:26.630724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:26.630724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:26.630724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:26.631820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:26.631820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:26.631820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:26.631820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:26.631820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:26.631820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:26.631820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:26.631820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:26.631820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:26.631820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:26.631820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:26.631820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:26.631820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 190/385] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:11:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:26.637396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528d0e8-2cf6-4853-9f87-af8febb672e0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:26.757214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:26.772558 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528d0e8-2cf6-4853-9f87-af8febb672e0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:26.811351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca99c8f-3362-49f1-b53b-4cb536eb25cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:26.811951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca99c8f-3362-49f1-b53b-4cb536eb25cc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:26.812293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca99c8f-3362-49f1-b53b-4cb536eb25cc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:26.812569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca99c8f-3362-49f1-b53b-4cb536eb25cc None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:26.813266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca99c8f-3362-49f1-b53b-4cb536eb25cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:26.813759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca99c8f-3362-49f1-b53b-4cb536eb25cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:26.815283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca99c8f-3362-49f1-b53b-4cb536eb25cc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:26.827275 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 196/386] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:26 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:26.828534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5b707-8297-4603-914d-4498c2d6250b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:26.839924 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca99c8f-3362-49f1-b53b-4cb536eb25cc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:26.917946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:27.004255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5b707-8297-4603-914d-4498c2d6250b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:27.051678 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485675e4-ac85-43b2-8e24-4ddc5010c722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:27.053327 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485675e4-ac85-43b2-8e24-4ddc5010c722 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:27.054026 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485675e4-ac85-43b2-8e24-4ddc5010c722 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:27.054610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485675e4-ac85-43b2-8e24-4ddc5010c722 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:27.077473 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485675e4-ac85-43b2-8e24-4ddc5010c722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:27.082613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-485675e4-ac85-43b2-8e24-4ddc5010c722 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:27.082613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:27.082613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:27.082613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:27.082613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:27.082613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:27.082613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:27.082613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:27.082613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:27.082613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:27.082613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:27.082613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:27.082613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:27.082613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:27.082613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:27.082613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:27.083756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:27.083756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:27.083756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:27.083756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:27.083756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:27.083756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:27.083756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:27.083756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:27.083756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:27.083756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:27.083756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:27.083756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:27.083756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:27.083756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:27.083756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:27.083756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:27.086385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:27.086385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:27.086385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:27.086385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:27.086385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:27.086385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:27.086385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:27.086385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:27.086385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:27.086385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:27.086385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:27.086385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:27.086385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 191/387] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:27.086385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b00e9-df9d-4fc3-9492-a9368e192b70 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:27.087132 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b00e9-df9d-4fc3-9492-a9368e192b70 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:27.087132 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b00e9-df9d-4fc3-9492-a9368e192b70 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:27.087903 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 192/388] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:27.093804 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b1651-cb0c-40d1-90d5-7839f4ebd77b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:27.094405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b1651-cb0c-40d1-90d5-7839f4ebd77b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:27.094872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b1651-cb0c-40d1-90d5-7839f4ebd77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:27.122513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca99c8f-3362-49f1-b53b-4cb536eb25cc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:27.129244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-894b1651-cb0c-40d1-90d5-7839f4ebd77b None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:27.130828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-894b1651-cb0c-40d1-90d5-7839f4ebd77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:27.174079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a281a0-59ca-44b3-8558-8d4980751e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:27.175842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a281a0-59ca-44b3-8558-8d4980751e08 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:27.176344 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a281a0-59ca-44b3-8558-8d4980751e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:27.176949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a281a0-59ca-44b3-8558-8d4980751e08 None admin] PATH_INFO: `/v3/groups/6377dcd6769240f7b51185157ee7b2ab` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:27.179126 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a281a0-59ca-44b3-8558-8d4980751e08 None admin] RBAC: Authorizing `identity:get_group(group_id=6377dcd6769240f7b51185157ee7b2ab)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:27.181215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a281a0-59ca-44b3-8558-8d4980751e08 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:27.183418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 197/389] 10.222.0.107 () {56 vars in 1185 bytes} [Tue Aug 23 23:11:26 2022] GET /identity/v3/groups/6377dcd6769240f7b51185157ee7b2ab => generated 227 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:27.184556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a281a0-59ca-44b3-8558-8d4980751e08 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:27.217186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:27.231590 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 193/390] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:27.233616 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b1651-cb0c-40d1-90d5-7839f4ebd77b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:27.313505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:27.424946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b1651-cb0c-40d1-90d5-7839f4ebd77b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:27.434227 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a281a0-59ca-44b3-8558-8d4980751e08 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:27.486813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26a4e7-6442-433a-a425-adc8f26ad08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:27.488375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26a4e7-6442-433a-a425-adc8f26ad08f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:27.489177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26a4e7-6442-433a-a425-adc8f26ad08f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:27.489941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26a4e7-6442-433a-a425-adc8f26ad08f None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:27.500629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26a4e7-6442-433a-a425-adc8f26ad08f None admin] RBAC: Authorizing `identity:get_project(project_id=7cf2243c0cdc44da93063ff4af6a2330)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:27.500629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26a4e7-6442-433a-a425-adc8f26ad08f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:27.500629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 194/391] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:27 2022] GET /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330 => generated 299 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:27.509047 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db83474-0992-4075-a827-c539101edb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:27.509679 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db83474-0992-4075-a827-c539101edb8a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:27.510034 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db83474-0992-4075-a827-c539101edb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:27.510306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db83474-0992-4075-a827-c539101edb8a None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:27.511036 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db83474-0992-4075-a827-c539101edb8a None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:27.511403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db83474-0992-4075-a827-c539101edb8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:27.512839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db83474-0992-4075-a827-c539101edb8a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:27.523296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 198/392] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:11:27 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:27.526779 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26a4e7-6442-433a-a425-adc8f26ad08f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:27.529165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db83474-0992-4075-a827-c539101edb8a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:27.683937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:27.706889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db83474-0992-4075-a827-c539101edb8a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:27.750834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81378d4-a759-4e19-bb12-0049b7d68f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:27.751494 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81378d4-a759-4e19-bb12-0049b7d68f8f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:27.752157 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81378d4-a759-4e19-bb12-0049b7d68f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:27.752447 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81378d4-a759-4e19-bb12-0049b7d68f8f None admin] PATH_INFO: `/v3/groups/6377dcd6769240f7b51185157ee7b2ab` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:27.753743 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81378d4-a759-4e19-bb12-0049b7d68f8f None admin] RBAC: Authorizing `identity:get_group(group_id=6377dcd6769240f7b51185157ee7b2ab)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:27.755227 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81378d4-a759-4e19-bb12-0049b7d68f8f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:27.757587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 199/393] 10.222.0.107 () {56 vars in 1185 bytes} [Tue Aug 23 23:11:27 2022] GET /identity/v3/groups/6377dcd6769240f7b51185157ee7b2ab => generated 227 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:27.766379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81378d4-a759-4e19-bb12-0049b7d68f8f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:27.805345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:27.811965 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26a4e7-6442-433a-a425-adc8f26ad08f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:27.885397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4d326-194b-4f47-9539-ca5b2f6edc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:27.886087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4d326-194b-4f47-9539-ca5b2f6edc7b None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:27.886368 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4d326-194b-4f47-9539-ca5b2f6edc7b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:27.886650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4d326-194b-4f47-9539-ca5b2f6edc7b None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330/groups/6377dcd6769240f7b51185157ee7b2ab/roles/8801d305c8374d34abe896d3b7685174` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:27.890109 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4d326-194b-4f47-9539-ca5b2f6edc7b None admin] RBAC: Authorizing `identity:create_grant(project_id=7cf2243c0cdc44da93063ff4af6a2330, group_id=6377dcd6769240f7b51185157ee7b2ab, role_id=8801d305c8374d34abe896d3b7685174)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:27.893814 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4d326-194b-4f47-9539-ca5b2f6edc7b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:27.914250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 195/394] 10.222.0.107 () {58 vars in 1447 bytes} [Tue Aug 23 23:11:27 2022] PUT /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330/groups/6377dcd6769240f7b51185157ee7b2ab/roles/8801d305c8374d34abe896d3b7685174 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:11:27.916212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4d326-194b-4f47-9539-ca5b2f6edc7b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:27.953646 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81378d4-a759-4e19-bb12-0049b7d68f8f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:28.011760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1ab61-bcda-4ea6-b659-20685aed1b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:28.012744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1ab61-bcda-4ea6-b659-20685aed1b60 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:28.013183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1ab61-bcda-4ea6-b659-20685aed1b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:28.013584 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1ab61-bcda-4ea6-b659-20685aed1b60 None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:28.015172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1ab61-bcda-4ea6-b659-20685aed1b60 None admin] RBAC: Authorizing `identity:get_project(project_id=7cf2243c0cdc44da93063ff4af6a2330)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:28.016904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1ab61-bcda-4ea6-b659-20685aed1b60 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:28.025436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 200/395] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:27 2022] GET /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330 => generated 299 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:28.027074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1ab61-bcda-4ea6-b659-20685aed1b60 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:28.076633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:28.219436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1ab61-bcda-4ea6-b659-20685aed1b60 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:28.263704 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9fbc9-20cf-437e-a8a4-c0822e8db6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:28.264669 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9fbc9-20cf-437e-a8a4-c0822e8db6e5 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:28.265093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9fbc9-20cf-437e-a8a4-c0822e8db6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:28.265507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9fbc9-20cf-437e-a8a4-c0822e8db6e5 None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330/groups/6377dcd6769240f7b51185157ee7b2ab/roles/6be1975947cd4b948b86c73132244927` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:28.267665 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9fbc9-20cf-437e-a8a4-c0822e8db6e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cf2243c0cdc44da93063ff4af6a2330, group_id=6377dcd6769240f7b51185157ee7b2ab, role_id=6be1975947cd4b948b86c73132244927)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:28.270081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9fbc9-20cf-437e-a8a4-c0822e8db6e5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:28.290016 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 201/396] 10.222.0.107 () {58 vars in 1447 bytes} [Tue Aug 23 23:11:28 2022] PUT /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330/groups/6377dcd6769240f7b51185157ee7b2ab/roles/6be1975947cd4b948b86c73132244927 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:11:28.303007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badfb60-bade-472c-b9a2-3289c0965d18 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:28.304149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badfb60-bade-472c-b9a2-3289c0965d18 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:28.305581 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badfb60-bade-472c-b9a2-3289c0965d18 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:28.309338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 202/397] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:28 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:11:28.315248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352490bc-eeb1-412b-99a9-b79b44ddb373 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:28.316002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352490bc-eeb1-412b-99a9-b79b44ddb373 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:28.316538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352490bc-eeb1-412b-99a9-b79b44ddb373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:28.318080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4d326-194b-4f47-9539-ca5b2f6edc7b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:28.360558 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-352490bc-eeb1-412b-99a9-b79b44ddb373 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:28.363040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-352490bc-eeb1-412b-99a9-b79b44ddb373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:28.414789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651767f3-cc5c-481d-be17-5cea769fcae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:28.416094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651767f3-cc5c-481d-be17-5cea769fcae4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:28.416621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651767f3-cc5c-481d-be17-5cea769fcae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:28.417850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651767f3-cc5c-481d-be17-5cea769fcae4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:28.450846 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651767f3-cc5c-481d-be17-5cea769fcae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:28.471249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-651767f3-cc5c-481d-be17-5cea769fcae4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:28.471249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:28.471249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:28.471249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:28.471249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:28.471249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:28.471249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:28.471249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:28.471249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:28.471249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:28.471249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:28.471249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:28.471249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:28.471249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:28.471249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:28.471249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:28.472287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:28.472287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:28.472287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:28.472287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:28.472287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:28.472287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:28.472287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:28.472287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:28.472287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:28.472287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:28.472287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:28.472287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:28.472287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:28.472287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:28.472287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:28.472287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:28.473162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:28.473162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:28.473162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:28.473162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:28.473162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:28.473162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:28.473162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:28.473162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:28.473162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:28.473162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:28.473162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:28.473162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:28.477568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 196/398] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 562 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:28.485807 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651767f3-cc5c-481d-be17-5cea769fcae4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:28.512552 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 203/399] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:28.521199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:28.656084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651767f3-cc5c-481d-be17-5cea769fcae4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:28.721806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9509bcd-1170-437f-b01d-8085cfd926ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:28.722722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9509bcd-1170-437f-b01d-8085cfd926ec None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:28.723497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9509bcd-1170-437f-b01d-8085cfd926ec None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:28.723947 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9509bcd-1170-437f-b01d-8085cfd926ec None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:28.726345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9509bcd-1170-437f-b01d-8085cfd926ec None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:28.726874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9509bcd-1170-437f-b01d-8085cfd926ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:28.729442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9509bcd-1170-437f-b01d-8085cfd926ec None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:28.744875 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 197/400] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:11:28 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:28.753790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352490bc-eeb1-412b-99a9-b79b44ddb373 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:28.763382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:28.826961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9509bcd-1170-437f-b01d-8085cfd926ec None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:28.901014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352490bc-eeb1-412b-99a9-b79b44ddb373 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:28.986373 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544622e2-0cee-4c69-b529-2d65c054b5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:28.987387 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544622e2-0cee-4c69-b529-2d65c054b5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:28.987884 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544622e2-0cee-4c69-b529-2d65c054b5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:28.990368 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544622e2-0cee-4c69-b529-2d65c054b5a1 None admin] PATH_INFO: `/v3/groups/6377dcd6769240f7b51185157ee7b2ab` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:28.995491 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544622e2-0cee-4c69-b529-2d65c054b5a1 None admin] RBAC: Authorizing `identity:get_group(group_id=6377dcd6769240f7b51185157ee7b2ab)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:29.000628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544622e2-0cee-4c69-b529-2d65c054b5a1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:29.002412 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 204/401] 10.222.0.107 () {56 vars in 1185 bytes} [Tue Aug 23 23:11:28 2022] GET /identity/v3/groups/6377dcd6769240f7b51185157ee7b2ab => generated 227 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:29.011682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544622e2-0cee-4c69-b529-2d65c054b5a1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:29.107447 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:29.162066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:29.163208 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9509bcd-1170-437f-b01d-8085cfd926ec None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:29.216793 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544622e2-0cee-4c69-b529-2d65c054b5a1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:29.246168 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c33b9f-577c-4a58-ade6-bd0e7cff0b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:29.246741 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c33b9f-577c-4a58-ade6-bd0e7cff0b7a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:29.247019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c33b9f-577c-4a58-ade6-bd0e7cff0b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:29.247291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c33b9f-577c-4a58-ade6-bd0e7cff0b7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:29.276363 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c33b9f-577c-4a58-ade6-bd0e7cff0b7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:29.282077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c9c33b9f-577c-4a58-ade6-bd0e7cff0b7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:29.282077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:29.282077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:29.282077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:29.282077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:29.282077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:29.282077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:29.282077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:29.282077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:29.282077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:29.282077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:29.282077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:29.282077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:29.282077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:29.282077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:29.282077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:29.283147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:29.283147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:29.283147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:29.283147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:29.283147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:29.283147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:29.283147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:29.283147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:29.283147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:29.283147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:29.283147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:29.283147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:29.283147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:29.283147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:29.283147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:29.283147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:29.284353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:29.284353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:29.284353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:29.284353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:29.284353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:29.284353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:29.284353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:29.284353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:29.284353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:29.284353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:29.284353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:29.284353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:29.284353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 198/402] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:11:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 458 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:29.302734 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c33b9f-577c-4a58-ade6-bd0e7cff0b7a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:29.323075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d1220-bd8c-45a0-be5c-536373894add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:29.323965 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d1220-bd8c-45a0-be5c-536373894add None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:29.323965 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d1220-bd8c-45a0-be5c-536373894add None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:29.324305 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d1220-bd8c-45a0-be5c-536373894add None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:29.326593 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d1220-bd8c-45a0-be5c-536373894add None admin] RBAC: Authorizing `identity:get_project(project_id=c75a8d1aa0614b1aa01db2d404827c77)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:29.328147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d1220-bd8c-45a0-be5c-536373894add None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:29.330011 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 205/403] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:29 2022] GET /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77 => generated 303 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:29.338195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d1220-bd8c-45a0-be5c-536373894add None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:29.459950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c33b9f-577c-4a58-ade6-bd0e7cff0b7a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:29.509030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0df970-dea8-42aa-8b50-0d79bc6f29c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:29.509565 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0df970-dea8-42aa-8b50-0d79bc6f29c6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:29.510025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0df970-dea8-42aa-8b50-0d79bc6f29c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:29.510301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0df970-dea8-42aa-8b50-0d79bc6f29c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:29.511511 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0df970-dea8-42aa-8b50-0d79bc6f29c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:29.511966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0df970-dea8-42aa-8b50-0d79bc6f29c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:29.513720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0df970-dea8-42aa-8b50-0d79bc6f29c6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:29.526093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 199/404] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:29 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:29.530137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bd99b-1811-47dc-a0d0-8b19b3e04bef None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:29.530417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bd99b-1811-47dc-a0d0-8b19b3e04bef None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:29.530728 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bd99b-1811-47dc-a0d0-8b19b3e04bef None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:29.540136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d1220-bd8c-45a0-be5c-536373894add None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:29.542374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 200/405] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:29 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:29.543405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bd99b-1811-47dc-a0d0-8b19b3e04bef None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:29.548556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:29.589319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d246c-798d-4ac4-9ad0-7bde76a1dbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:29.590010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d246c-798d-4ac4-9ad0-7bde76a1dbce None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:29.590287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d246c-798d-4ac4-9ad0-7bde76a1dbce None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:29.590560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d246c-798d-4ac4-9ad0-7bde76a1dbce None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77/groups/6377dcd6769240f7b51185157ee7b2ab/roles/6be1975947cd4b948b86c73132244927` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:29.593007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d246c-798d-4ac4-9ad0-7bde76a1dbce None admin] RBAC: Authorizing `identity:create_grant(project_id=c75a8d1aa0614b1aa01db2d404827c77, group_id=6377dcd6769240f7b51185157ee7b2ab, role_id=6be1975947cd4b948b86c73132244927)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:29.595604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d246c-798d-4ac4-9ad0-7bde76a1dbce None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:29.614072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 206/406] 10.222.0.107 () {58 vars in 1447 bytes} [Tue Aug 23 23:11:29 2022] PUT /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77/groups/6377dcd6769240f7b51185157ee7b2ab/roles/6be1975947cd4b948b86c73132244927 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:29.615381 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9f77d-2a54-4687-882f-878a022b9ebd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:29.616242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9f77d-2a54-4687-882f-878a022b9ebd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:29.616527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9f77d-2a54-4687-882f-878a022b9ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:29.625174 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:29.647792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d1c9f77d-2a54-4687-882f-878a022b9ebd None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:29.650470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d1c9f77d-2a54-4687-882f-878a022b9ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:29.690588 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bd99b-1811-47dc-a0d0-8b19b3e04bef None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:29.733926 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555902d-5877-4245-a015-3af221e024f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:29.734638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555902d-5877-4245-a015-3af221e024f2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:29.734916 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555902d-5877-4245-a015-3af221e024f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:29.735191 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555902d-5877-4245-a015-3af221e024f2 None admin] PATH_INFO: `/v3/groups/6377dcd6769240f7b51185157ee7b2ab` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:29.736434 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555902d-5877-4245-a015-3af221e024f2 None admin] RBAC: Authorizing `identity:get_group(group_id=6377dcd6769240f7b51185157ee7b2ab)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:29.738971 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555902d-5877-4245-a015-3af221e024f2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:29.741351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 201/407] 10.222.0.107 () {56 vars in 1185 bytes} [Tue Aug 23 23:11:29 2022] GET /identity/v3/groups/6377dcd6769240f7b51185157ee7b2ab => generated 227 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:29.746905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555902d-5877-4245-a015-3af221e024f2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:29.768558 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 207/408] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:29.892053 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:29.944279 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555902d-5877-4245-a015-3af221e024f2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:30.005277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffdd43-d841-4851-a3fe-72b91730818f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:30.005956 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffdd43-d841-4851-a3fe-72b91730818f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:30.006265 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffdd43-d841-4851-a3fe-72b91730818f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:30.007089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffdd43-d841-4851-a3fe-72b91730818f None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:30.008569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffdd43-d841-4851-a3fe-72b91730818f None admin] RBAC: Authorizing `identity:get_project(project_id=c75a8d1aa0614b1aa01db2d404827c77)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:30.010319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffdd43-d841-4851-a3fe-72b91730818f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:30.012496 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 202/409] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:29 2022] GET /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77 => generated 303 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:30.018541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9f77d-2a54-4687-882f-878a022b9ebd None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:30.186247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffdd43-d841-4851-a3fe-72b91730818f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:30.187420 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9f77d-2a54-4687-882f-878a022b9ebd None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:30.222839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:30.242997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c255b-fe9b-4f19-b276-7ecb84d1e741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:30.243740 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c255b-fe9b-4f19-b276-7ecb84d1e741 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:30.244022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c255b-fe9b-4f19-b276-7ecb84d1e741 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:30.244292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c255b-fe9b-4f19-b276-7ecb84d1e741 None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77/groups/6377dcd6769240f7b51185157ee7b2ab/roles/8801d305c8374d34abe896d3b7685174` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:30.250420 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c255b-fe9b-4f19-b276-7ecb84d1e741 None admin] RBAC: Authorizing `identity:create_grant(project_id=c75a8d1aa0614b1aa01db2d404827c77, group_id=6377dcd6769240f7b51185157ee7b2ab, role_id=8801d305c8374d34abe896d3b7685174)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:30.251885 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c255b-fe9b-4f19-b276-7ecb84d1e741 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:30.283282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 208/410] 10.222.0.107 () {58 vars in 1447 bytes} [Tue Aug 23 23:11:30 2022] PUT /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77/groups/6377dcd6769240f7b51185157ee7b2ab/roles/8801d305c8374d34abe896d3b7685174 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:30.322065 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffdd43-d841-4851-a3fe-72b91730818f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:30.388028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f37c1-b6a6-4778-a890-144f07422d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:30.389018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f37c1-b6a6-4778-a890-144f07422d63 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:30.389495 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f37c1-b6a6-4778-a890-144f07422d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:30.389916 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f37c1-b6a6-4778-a890-144f07422d63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:30.405983 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:30.411806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f37c1-b6a6-4778-a890-144f07422d63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:30.418173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-1f7f37c1-b6a6-4778-a890-144f07422d63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:30.418173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:30.418173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:30.418173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:30.418173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:30.418173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:30.418173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:30.418173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:30.418173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:30.418173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:30.418173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:30.418173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:30.418173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:30.418173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:30.418173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:30.418173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:30.419323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:30.419323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:30.419323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:30.419323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:30.419323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:30.419323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:30.419323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:30.419323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:30.419323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:30.419323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:30.419323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:30.419323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:30.419323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:30.419323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:30.419323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:30.419323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:30.420347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:30.420347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:30.420347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:30.420347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:30.420347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:30.420347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:30.420347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:30.420347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:30.420347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:30.420347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:30.420347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:30.420347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:30.422910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 203/411] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:11:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:30.430073 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c255b-fe9b-4f19-b276-7ecb84d1e741 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:30.583205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c255b-fe9b-4f19-b276-7ecb84d1e741 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:30.637823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bde0bb-c851-49d2-acc5-444d8e0f8e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:30.638731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bde0bb-c851-49d2-acc5-444d8e0f8e5d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:30.639156 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bde0bb-c851-49d2-acc5-444d8e0f8e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:30.639572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bde0bb-c851-49d2-acc5-444d8e0f8e5d None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:30.640400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bde0bb-c851-49d2-acc5-444d8e0f8e5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:30.640875 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bde0bb-c851-49d2-acc5-444d8e0f8e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:30.642515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bde0bb-c851-49d2-acc5-444d8e0f8e5d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:30.657291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 209/412] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:30 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:30.663693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f37c1-b6a6-4778-a890-144f07422d63 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:30.824310 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f37c1-b6a6-4778-a890-144f07422d63 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:30.877091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa70acd-dcbd-43cb-81f4-71adb43a73a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:30.877651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa70acd-dcbd-43cb-81f4-71adb43a73a5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:30.877931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa70acd-dcbd-43cb-81f4-71adb43a73a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:30.878211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa70acd-dcbd-43cb-81f4-71adb43a73a5 None admin] PATH_INFO: `/v3/groups/42552607c43a49dc9b2a0b446fae60c4` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:30.885446 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa70acd-dcbd-43cb-81f4-71adb43a73a5 None admin] RBAC: Authorizing `identity:get_group(group_id=42552607c43a49dc9b2a0b446fae60c4)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:30.886938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa70acd-dcbd-43cb-81f4-71adb43a73a5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:30.888992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 204/413] 10.222.0.107 () {56 vars in 1185 bytes} [Tue Aug 23 23:11:30 2022] GET /identity/v3/groups/42552607c43a49dc9b2a0b446fae60c4 => generated 230 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:30.895307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bde0bb-c851-49d2-acc5-444d8e0f8e5d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:30.961103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b337b-0ce5-47b7-a32b-8cac5eddb312 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:30.961536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b337b-0ce5-47b7-a32b-8cac5eddb312 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:30.961918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b337b-0ce5-47b7-a32b-8cac5eddb312 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:30.965614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 205/414] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:30 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:30.971261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbafad-4d68-4857-95d7-9884a4fd92a1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:30.971564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbafad-4d68-4857-95d7-9884a4fd92a1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:30.971796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbafad-4d68-4857-95d7-9884a4fd92a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:30.992982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:31.005818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b9bbafad-4d68-4857-95d7-9884a4fd92a1 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:31.007763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b9bbafad-4d68-4857-95d7-9884a4fd92a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:31.077346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bde0bb-c851-49d2-acc5-444d8e0f8e5d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:31.142586 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6c24a-7d94-45c2-a03f-88b773d6ed8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:31.143364 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6c24a-7d94-45c2-a03f-88b773d6ed8a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:31.145165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6c24a-7d94-45c2-a03f-88b773d6ed8a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:31.145444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6c24a-7d94-45c2-a03f-88b773d6ed8a None admin] PATH_INFO: `/v3/projects/2ab98da0af85419a9eb4e9e222c7d0ea` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:31.148815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6c24a-7d94-45c2-a03f-88b773d6ed8a None admin] RBAC: Authorizing `identity:get_project(project_id=2ab98da0af85419a9eb4e9e222c7d0ea)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:31.150682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6c24a-7d94-45c2-a03f-88b773d6ed8a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:31.153895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 210/415] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:30 2022] GET /identity/v3/projects/2ab98da0af85419a9eb4e9e222c7d0ea => generated 345 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:31.155455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:31.158837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6c24a-7d94-45c2-a03f-88b773d6ed8a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:31.170905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 206/416] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:31.359727 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6c24a-7d94-45c2-a03f-88b773d6ed8a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:31.374820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fa729-a4f6-4abb-913b-0f8b71f99421 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:31.375185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fa729-a4f6-4abb-913b-0f8b71f99421 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:31.375377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fa729-a4f6-4abb-913b-0f8b71f99421 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:31.377042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 207/417] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:31.383493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be8974-1bc2-454c-ba67-1d1823a202b8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:31.383870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be8974-1bc2-454c-ba67-1d1823a202b8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:31.384138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be8974-1bc2-454c-ba67-1d1823a202b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:31.402865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:31.407742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-17be8974-1bc2-454c-ba67-1d1823a202b8 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:31.409845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-17be8974-1bc2-454c-ba67-1d1823a202b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:31.431681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8664e5-b578-4807-bfd0-47a6f1910673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:31.432365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8664e5-b578-4807-bfd0-47a6f1910673 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:31.432664 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8664e5-b578-4807-bfd0-47a6f1910673 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:31.432944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8664e5-b578-4807-bfd0-47a6f1910673 None admin] PATH_INFO: `/v3/projects/2ab98da0af85419a9eb4e9e222c7d0ea/groups/42552607c43a49dc9b2a0b446fae60c4/roles/97ece22f2e264e0e857d5107325a85d9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:31.437894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8664e5-b578-4807-bfd0-47a6f1910673 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ab98da0af85419a9eb4e9e222c7d0ea, group_id=42552607c43a49dc9b2a0b446fae60c4, role_id=97ece22f2e264e0e857d5107325a85d9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:31.439353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8664e5-b578-4807-bfd0-47a6f1910673 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:31.469490 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 211/418] 10.222.0.107 () {58 vars in 1447 bytes} [Tue Aug 23 23:11:31 2022] PUT /identity/v3/projects/2ab98da0af85419a9eb4e9e222c7d0ea/groups/42552607c43a49dc9b2a0b446fae60c4/roles/97ece22f2e264e0e857d5107325a85d9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:31.494824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8664e5-b578-4807-bfd0-47a6f1910673 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:31.515203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 208/419] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:31.689256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8664e5-b578-4807-bfd0-47a6f1910673 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:31.728228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d50bf-c27b-492a-bbd2-2ea7898c11aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:31.729278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d50bf-c27b-492a-bbd2-2ea7898c11aa None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:31.729740 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d50bf-c27b-492a-bbd2-2ea7898c11aa None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:31.730189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d50bf-c27b-492a-bbd2-2ea7898c11aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:31.743690 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d50bf-c27b-492a-bbd2-2ea7898c11aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:31.749836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-881d50bf-c27b-492a-bbd2-2ea7898c11aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:31.749836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:31.749836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:31.749836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:31.749836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:31.749836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:31.749836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:31.749836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:31.749836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:31.749836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:31.749836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:31.749836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:31.749836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:31.749836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:31.749836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:31.749836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:31.750763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:31.750763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:31.750763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:31.750763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:31.750763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:31.750763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:31.750763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:31.750763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:31.750763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:31.750763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:31.750763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:31.750763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:31.750763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:31.750763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:31.750763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:31.750763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:31.751633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:31.751633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:31.751633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:31.751633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:31.751633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:31.751633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:31.751633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:31.751633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:31.751633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:31.751633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:31.751633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:31.751633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:31.753917 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 212/420] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:11:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:11:31.759997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be8974-1bc2-454c-ba67-1d1823a202b8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:31.861986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d50bf-c27b-492a-bbd2-2ea7898c11aa None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:31.926375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:31.940165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be8974-1bc2-454c-ba67-1d1823a202b8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:31.995689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:32.008364 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a92b5-39ce-4c0e-a7f4-2dbddea33654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:32.009012 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a92b5-39ce-4c0e-a7f4-2dbddea33654 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:32.009295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a92b5-39ce-4c0e-a7f4-2dbddea33654 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:32.009571 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a92b5-39ce-4c0e-a7f4-2dbddea33654 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:32.010249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a92b5-39ce-4c0e-a7f4-2dbddea33654 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:32.010552 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a92b5-39ce-4c0e-a7f4-2dbddea33654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:32.011942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a92b5-39ce-4c0e-a7f4-2dbddea33654 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:32.034024 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 209/421] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:31 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:32.038555 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a92b5-39ce-4c0e-a7f4-2dbddea33654 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:32.044740 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d50bf-c27b-492a-bbd2-2ea7898c11aa None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:32.109999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cefe35-75f6-416b-90b9-b29e9d6442f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:32.111069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cefe35-75f6-416b-90b9-b29e9d6442f8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:32.111539 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cefe35-75f6-416b-90b9-b29e9d6442f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:32.112023 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cefe35-75f6-416b-90b9-b29e9d6442f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:32.133673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cefe35-75f6-416b-90b9-b29e9d6442f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:32.139625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-c1cefe35-75f6-416b-90b9-b29e9d6442f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:32.139625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:32.139625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:32.139625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:32.139625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:32.139625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:32.139625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:32.139625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:32.139625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:32.139625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:32.139625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:32.139625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:32.139625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:32.139625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:32.139625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:32.139625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:32.140520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:32.140520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:32.140520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:32.140520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:32.140520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:32.140520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:32.140520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:32.140520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:32.140520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:32.140520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:32.140520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:32.140520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:32.140520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:32.140520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:32.140520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:32.140520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:32.141389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:32.141389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:32.141389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:32.141389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:32.141389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:32.141389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:32.141389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:32.141389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:32.141389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:32.141389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:32.141389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:32.141389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:32.149339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 213/422] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:32.155739 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cefe35-75f6-416b-90b9-b29e9d6442f8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:32.191302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a92b5-39ce-4c0e-a7f4-2dbddea33654 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:32.250422 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f40a0-12ba-4c04-a079-5f5bf7c26e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:32.251052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f40a0-12ba-4c04-a079-5f5bf7c26e7f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:32.251332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f40a0-12ba-4c04-a079-5f5bf7c26e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:32.251603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f40a0-12ba-4c04-a079-5f5bf7c26e7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:32.325938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:32.337185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cefe35-75f6-416b-90b9-b29e9d6442f8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:32.339223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f40a0-12ba-4c04-a079-5f5bf7c26e7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:32.345902 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f40a0-12ba-4c04-a079-5f5bf7c26e7f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:32.346060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:32.399412 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b543f3e-0db6-4914-84cb-52bc4c93f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:32.400480 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b543f3e-0db6-4914-84cb-52bc4c93f10a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:32.401059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b543f3e-0db6-4914-84cb-52bc4c93f10a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:32.401522 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b543f3e-0db6-4914-84cb-52bc4c93f10a None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:32.402410 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b543f3e-0db6-4914-84cb-52bc4c93f10a None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:32.402931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b543f3e-0db6-4914-84cb-52bc4c93f10a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:32.404752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b543f3e-0db6-4914-84cb-52bc4c93f10a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:32.416305 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 214/423] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:11:32 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:32.418267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36786b0-5372-4498-aa03-254da784f851 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:32.418742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36786b0-5372-4498-aa03-254da784f851 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:32.419182 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36786b0-5372-4498-aa03-254da784f851 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:32.420932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 215/424] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:32.423534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36786b0-5372-4498-aa03-254da784f851 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:32.459516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 210/425] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:32 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:32.461926 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6daf2-dd53-4fc3-84d8-e05d960e90bf None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:32.462211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6daf2-dd53-4fc3-84d8-e05d960e90bf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:32.462483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6daf2-dd53-4fc3-84d8-e05d960e90bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:32.482173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7fe6daf2-dd53-4fc3-84d8-e05d960e90bf None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:32.483395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7fe6daf2-dd53-4fc3-84d8-e05d960e90bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:32.560651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 211/426] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:32.561837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6daf2-dd53-4fc3-84d8-e05d960e90bf None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:32.585373 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36786b0-5372-4498-aa03-254da784f851 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:32.589165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:32.670183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6daf2-dd53-4fc3-84d8-e05d960e90bf None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:32.707173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54fb06-332e-4eca-b5aa-df81338d5462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:32.707809 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54fb06-332e-4eca-b5aa-df81338d5462 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:32.708089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54fb06-332e-4eca-b5aa-df81338d5462 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:32.708364 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54fb06-332e-4eca-b5aa-df81338d5462 None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:32.710233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54fb06-332e-4eca-b5aa-df81338d5462 None admin] RBAC: Authorizing `identity:get_project(project_id=7cf2243c0cdc44da93063ff4af6a2330)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:32.711325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54fb06-332e-4eca-b5aa-df81338d5462 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:32.712996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 212/427] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:32 2022] GET /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330 => generated 299 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:32.721601 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54fb06-332e-4eca-b5aa-df81338d5462 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:32.721802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c43e9-d705-4acc-8c7b-bd1b0501a2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:32.722812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c43e9-d705-4acc-8c7b-bd1b0501a2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:32.723316 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c43e9-d705-4acc-8c7b-bd1b0501a2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:32.723818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c43e9-d705-4acc-8c7b-bd1b0501a2d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:32.800979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:32.866282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c43e9-d705-4acc-8c7b-bd1b0501a2d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:32.868202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c43e9-d705-4acc-8c7b-bd1b0501a2d3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:32.902981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:32.924701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54fb06-332e-4eca-b5aa-df81338d5462 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:32.990256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facc365-54e1-409d-a496-3d805b27b804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:32.991658 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facc365-54e1-409d-a496-3d805b27b804 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:32.992038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facc365-54e1-409d-a496-3d805b27b804 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:32.992352 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facc365-54e1-409d-a496-3d805b27b804 None admin] PATH_INFO: `/v3/groups/6377dcd6769240f7b51185157ee7b2ab` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.000628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facc365-54e1-409d-a496-3d805b27b804 None admin] RBAC: Authorizing `identity:get_group(group_id=6377dcd6769240f7b51185157ee7b2ab)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:33.000628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facc365-54e1-409d-a496-3d805b27b804 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:33.008974 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 213/428] 10.222.0.107 () {56 vars in 1185 bytes} [Tue Aug 23 23:11:32 2022] GET /identity/v3/groups/6377dcd6769240f7b51185157ee7b2ab => generated 227 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:33.014547 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facc365-54e1-409d-a496-3d805b27b804 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.118118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 216/429] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:32 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:11:33.121336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adefa0f-3416-4ab9-a250-e8601cab08e0 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.122201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adefa0f-3416-4ab9-a250-e8601cab08e0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.122750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adefa0f-3416-4ab9-a250-e8601cab08e0 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.125897 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 217/430] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:33 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:33.128250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adefa0f-3416-4ab9-a250-e8601cab08e0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.181282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facc365-54e1-409d-a496-3d805b27b804 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:33.212264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:33.220805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e97a23-606f-40b0-b348-f0c3dc152cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:33.221468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e97a23-606f-40b0-b348-f0c3dc152cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.221792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e97a23-606f-40b0-b348-f0c3dc152cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.222068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e97a23-606f-40b0-b348-f0c3dc152cb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.222891 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e97a23-606f-40b0-b348-f0c3dc152cb7 None admin] RBAC: Adding query filter params (group.id=6377dcd6769240f7b51185157ee7b2ab, role.id=8801d305c8374d34abe896d3b7685174, scope.project.id=7cf2243c0cdc44da93063ff4af6a2330) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:33.223219 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e97a23-606f-40b0-b348-f0c3dc152cb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:33.224794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e97a23-606f-40b0-b348-f0c3dc152cb7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:33.244726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 214/431] 10.222.0.107 () {56 vars in 1381 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/role_assignments?group.id=6377dcd6769240f7b51185157ee7b2ab&scope.project.id=7cf2243c0cdc44da93063ff4af6a2330&role.id=8801d305c8374d34abe896d3b7685174 => generated 613 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:33.244726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e97a23-606f-40b0-b348-f0c3dc152cb7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.270271 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:33.283288 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adefa0f-3416-4ab9-a250-e8601cab08e0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:33.339309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c78b0-5f76-438d-8ba1-380be624c377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:33.340113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c78b0-5f76-438d-8ba1-380be624c377 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.340447 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c78b0-5f76-438d-8ba1-380be624c377 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.340676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c78b0-5f76-438d-8ba1-380be624c377 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.354546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c78b0-5f76-438d-8ba1-380be624c377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:33.359645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f88c78b0-5f76-438d-8ba1-380be624c377 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:33.359645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:33.359645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:33.359645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:33.359645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:33.359645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:33.359645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:33.359645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:33.359645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:33.359645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:33.359645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:33.359645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:33.359645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:33.359645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:33.359645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:33.359645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:33.360621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:33.360621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:33.360621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:33.360621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:33.360621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:33.360621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:33.360621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:33.360621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:33.360621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:33.360621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:33.360621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:33.360621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:33.360621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:33.360621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:33.360621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:33.360621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:33.361443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:33.361443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:33.361443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:33.361443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:33.361443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:33.361443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:33.361443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:33.361443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:33.361443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:33.361443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:33.361443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:11:33.361443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:33.366459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 218/432] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:33.368456 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13df093-4eaf-42b0-bea2-d02d0bd8c416 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.368456 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13df093-4eaf-42b0-bea2-d02d0bd8c416 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.368456 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13df093-4eaf-42b0-bea2-d02d0bd8c416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.391852 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d13df093-4eaf-42b0-bea2-d02d0bd8c416 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:33.393340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d13df093-4eaf-42b0-bea2-d02d0bd8c416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:33.414794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e97a23-606f-40b0-b348-f0c3dc152cb7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:33.463515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b817ca-3950-41ba-ae8d-e690616fd50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:33.464159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b817ca-3950-41ba-ae8d-e690616fd50c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.464493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b817ca-3950-41ba-ae8d-e690616fd50c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.464853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b817ca-3950-41ba-ae8d-e690616fd50c None admin] PATH_INFO: `/v3/projects/7cf2243c0cdc44da93063ff4af6a2330` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.468504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b817ca-3950-41ba-ae8d-e690616fd50c None admin] RBAC: Authorizing `identity:get_project(project_id=7cf2243c0cdc44da93063ff4af6a2330)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:33.468504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b817ca-3950-41ba-ae8d-e690616fd50c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:33.470470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 215/433] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/projects/7cf2243c0cdc44da93063ff4af6a2330 => generated 299 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:33.471100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b817ca-3950-41ba-ae8d-e690616fd50c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.487237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 219/434] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:33.488420 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13df093-4eaf-42b0-bea2-d02d0bd8c416 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.566017 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:33.578858 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:33.594687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b817ca-3950-41ba-ae8d-e690616fd50c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:33.626928 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13df093-4eaf-42b0-bea2-d02d0bd8c416 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:33.650002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2c84a-c841-429a-a80f-90e90e09936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:33.650780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2c84a-c841-429a-a80f-90e90e09936e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.651166 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2c84a-c841-429a-a80f-90e90e09936e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.651545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2c84a-c841-429a-a80f-90e90e09936e None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.652429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2c84a-c841-429a-a80f-90e90e09936e None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:33.652778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2c84a-c841-429a-a80f-90e90e09936e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:33.654306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2c84a-c841-429a-a80f-90e90e09936e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:33.668777 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 216/435] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:33.670672 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2c84a-c841-429a-a80f-90e90e09936e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.682601 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cbfe5-4234-4a06-b2b7-323bcb585687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:33.683770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cbfe5-4234-4a06-b2b7-323bcb585687 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.684325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cbfe5-4234-4a06-b2b7-323bcb585687 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.685037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cbfe5-4234-4a06-b2b7-323bcb585687 None admin] PATH_INFO: `/v3/groups/6377dcd6769240f7b51185157ee7b2ab` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.687084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cbfe5-4234-4a06-b2b7-323bcb585687 None admin] RBAC: Authorizing `identity:get_group(group_id=6377dcd6769240f7b51185157ee7b2ab)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:33.689323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cbfe5-4234-4a06-b2b7-323bcb585687 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:33.691952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 220/436] 10.222.0.107 () {56 vars in 1185 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/groups/6377dcd6769240f7b51185157ee7b2ab => generated 227 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:33.700627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cbfe5-4234-4a06-b2b7-323bcb585687 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.803743 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2c84a-c841-429a-a80f-90e90e09936e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:33.819286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cbfe5-4234-4a06-b2b7-323bcb585687 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:33.843936 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5a50e-2ad5-4bc5-8c27-8b3130a70169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:33.844308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:33.844673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5a50e-2ad5-4bc5-8c27-8b3130a70169 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.844951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5a50e-2ad5-4bc5-8c27-8b3130a70169 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.845640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5a50e-2ad5-4bc5-8c27-8b3130a70169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.857329 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a3474-494e-4822-bd74-ded4f0a1e43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:33.857935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a3474-494e-4822-bd74-ded4f0a1e43b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.858210 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a3474-494e-4822-bd74-ded4f0a1e43b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.858484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a3474-494e-4822-bd74-ded4f0a1e43b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.859217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a3474-494e-4822-bd74-ded4f0a1e43b None admin] RBAC: Adding query filter params (group.id=6377dcd6769240f7b51185157ee7b2ab, role.id=6be1975947cd4b948b86c73132244927, scope.project.id=7cf2243c0cdc44da93063ff4af6a2330) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:33.859575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a3474-494e-4822-bd74-ded4f0a1e43b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:33.860984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a3474-494e-4822-bd74-ded4f0a1e43b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:33.868442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 221/437] 10.222.0.107 () {56 vars in 1381 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/role_assignments?group.id=6377dcd6769240f7b51185157ee7b2ab&scope.project.id=7cf2243c0cdc44da93063ff4af6a2330&role.id=6be1975947cd4b948b86c73132244927 => generated 613 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:33.869807 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d53222-1b78-4c20-aaa7-5cf1848d610f None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.870085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d53222-1b78-4c20-aaa7-5cf1848d610f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.870351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d53222-1b78-4c20-aaa7-5cf1848d610f None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.871545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 222/438] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:33.872248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d53222-1b78-4c20-aaa7-5cf1848d610f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.885019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:33.952266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5a50e-2ad5-4bc5-8c27-8b3130a70169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:33.953843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5a50e-2ad5-4bc5-8c27-8b3130a70169 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:34.008053 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d53222-1b78-4c20-aaa7-5cf1848d610f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:34.056187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2e4f7-9483-435a-b5f8-86ea6d044d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:34.056973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2e4f7-9483-435a-b5f8-86ea6d044d8c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:34.057253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2e4f7-9483-435a-b5f8-86ea6d044d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:34.057525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2e4f7-9483-435a-b5f8-86ea6d044d8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:34.073593 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2e4f7-9483-435a-b5f8-86ea6d044d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:34.078841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a1d2e4f7-9483-435a-b5f8-86ea6d044d8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:34.078841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:34.078841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:34.078841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:34.078841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:34.078841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:34.078841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:34.078841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:34.078841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:34.078841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:34.078841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:34.078841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:34.078841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:34.078841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:34.078841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:34.078841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:34.079773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:34.079773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:34.079773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:34.079773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:34.079773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:34.079773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:34.079773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:34.079773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:34.079773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:34.079773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:34.079773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:34.079773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:34.079773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:34.079773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:34.079773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:34.079773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:34.080570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:34.080570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:34.080570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:34.080570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:34.080570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:34.080570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:34.080570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:34.080570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:34.080570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:34.080570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:34.080570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:34.080570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:34.080570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 223/439] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:34.081249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bda5e-8edc-4703-a060-b163271f1ac1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:34.081804 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bda5e-8edc-4703-a060-b163271f1ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:34.081804 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bda5e-8edc-4703-a060-b163271f1ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:34.094828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 217/440] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:34.096693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5a50e-2ad5-4bc5-8c27-8b3130a70169 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:34.102412 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ff6bda5e-8edc-4703-a060-b163271f1ac1 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:34.103643 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ff6bda5e-8edc-4703-a060-b163271f1ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:34.154189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:34.159450 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:34.187878 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 224/441] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:34.189003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bda5e-8edc-4703-a060-b163271f1ac1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:34.246702 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5a50e-2ad5-4bc5-8c27-8b3130a70169 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:34.304104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20193d0-7dd9-4ae8-892c-f6ad16afe32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:34.305209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20193d0-7dd9-4ae8-892c-f6ad16afe32a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:34.305699 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20193d0-7dd9-4ae8-892c-f6ad16afe32a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:34.306198 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20193d0-7dd9-4ae8-892c-f6ad16afe32a None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:34.307457 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20193d0-7dd9-4ae8-892c-f6ad16afe32a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:34.308055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20193d0-7dd9-4ae8-892c-f6ad16afe32a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:34.310803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20193d0-7dd9-4ae8-892c-f6ad16afe32a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:34.330250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 218/442] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:34 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:34.340804 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20193d0-7dd9-4ae8-892c-f6ad16afe32a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:34.340991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bda5e-8edc-4703-a060-b163271f1ac1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:34.389073 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cba86f-23f8-4a38-890b-9001d4da707a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:34.389713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cba86f-23f8-4a38-890b-9001d4da707a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:34.389985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cba86f-23f8-4a38-890b-9001d4da707a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:34.390256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cba86f-23f8-4a38-890b-9001d4da707a None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:34.391621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cba86f-23f8-4a38-890b-9001d4da707a None admin] RBAC: Authorizing `identity:get_project(project_id=c75a8d1aa0614b1aa01db2d404827c77)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:34.393092 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cba86f-23f8-4a38-890b-9001d4da707a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:34.395122 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 225/443] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:34 2022] GET /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77 => generated 303 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:34.401919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cba86f-23f8-4a38-890b-9001d4da707a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:34.464870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:34.485357 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20193d0-7dd9-4ae8-892c-f6ad16afe32a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:34.503768 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:34.532587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cba86f-23f8-4a38-890b-9001d4da707a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:34.533399 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7641e-e486-40ff-b6c3-01fe89eb6014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:34.534045 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7641e-e486-40ff-b6c3-01fe89eb6014 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:34.534326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7641e-e486-40ff-b6c3-01fe89eb6014 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:34.534597 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7641e-e486-40ff-b6c3-01fe89eb6014 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:34.567910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa25aaf-3f08-4a15-82b1-45ced6b6456a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:34.568538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa25aaf-3f08-4a15-82b1-45ced6b6456a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:34.568863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa25aaf-3f08-4a15-82b1-45ced6b6456a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:34.569163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa25aaf-3f08-4a15-82b1-45ced6b6456a None admin] PATH_INFO: `/v3/groups/6377dcd6769240f7b51185157ee7b2ab` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:34.570306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa25aaf-3f08-4a15-82b1-45ced6b6456a None admin] RBAC: Authorizing `identity:get_group(group_id=6377dcd6769240f7b51185157ee7b2ab)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:34.571727 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa25aaf-3f08-4a15-82b1-45ced6b6456a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:34.573324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 226/444] 10.222.0.107 () {56 vars in 1185 bytes} [Tue Aug 23 23:11:34 2022] GET /identity/v3/groups/6377dcd6769240f7b51185157ee7b2ab => generated 227 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:34.574071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa25aaf-3f08-4a15-82b1-45ced6b6456a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:34.609993 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7641e-e486-40ff-b6c3-01fe89eb6014 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:34.611380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7641e-e486-40ff-b6c3-01fe89eb6014 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:34.674583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa25aaf-3f08-4a15-82b1-45ced6b6456a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:34.688399 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:34.711534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41633ff0-313a-432c-840b-787cd93f6347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:34.712060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 219/445] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:34 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:34.712171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41633ff0-313a-432c-840b-787cd93f6347 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:34.712378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41633ff0-313a-432c-840b-787cd93f6347 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:34.712674 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41633ff0-313a-432c-840b-787cd93f6347 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:34.712937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7641e-e486-40ff-b6c3-01fe89eb6014 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:34.723087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41633ff0-313a-432c-840b-787cd93f6347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:34.727942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:34.728695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-41633ff0-313a-432c-840b-787cd93f6347 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:34.728695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:34.728695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:34.728695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:34.728695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:34.728695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:34.728695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:34.728695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:34.728695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:34.728695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:34.728695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:34.728695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:34.728695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:34.728695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:34.728695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:34.728695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:34.729723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:34.729723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:34.729723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:34.729723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:34.729723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:34.729723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:34.729723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:34.729723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:34.729723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:34.729723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:34.729723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:34.729723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:34.729723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:34.729723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:34.729723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:34.729723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:34.730564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:34.730564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:34.730564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:34.730564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:34.730564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:34.730564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:34.730564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:34.730564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:34.730564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:34.730564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:34.730564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:34.730564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:34.730564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 227/446] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:11:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:34.730564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41633ff0-313a-432c-840b-787cd93f6347 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:34.818948 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7641e-e486-40ff-b6c3-01fe89eb6014 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:34.837363 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41633ff0-313a-432c-840b-787cd93f6347 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:34.855114 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58792c-d00a-403d-9f1d-b1ab83d3be21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:34.855725 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58792c-d00a-403d-9f1d-b1ab83d3be21 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:34.855997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58792c-d00a-403d-9f1d-b1ab83d3be21 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:34.856264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58792c-d00a-403d-9f1d-b1ab83d3be21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:34.857019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58792c-d00a-403d-9f1d-b1ab83d3be21 None admin] RBAC: Adding query filter params (group.id=6377dcd6769240f7b51185157ee7b2ab, role.id=6be1975947cd4b948b86c73132244927, scope.project.id=c75a8d1aa0614b1aa01db2d404827c77) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:34.857317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58792c-d00a-403d-9f1d-b1ab83d3be21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:34.858752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58792c-d00a-403d-9f1d-b1ab83d3be21 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:34.864955 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 220/447] 10.222.0.107 () {56 vars in 1381 bytes} [Tue Aug 23 23:11:34 2022] GET /identity/v3/role_assignments?group.id=6377dcd6769240f7b51185157ee7b2ab&scope.project.id=c75a8d1aa0614b1aa01db2d404827c77&role.id=6be1975947cd4b948b86c73132244927 => generated 613 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:34.866381 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58792c-d00a-403d-9f1d-b1ab83d3be21 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:34.875729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ad8ad-2ada-4571-8303-4105c31002de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:34.876391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ad8ad-2ada-4571-8303-4105c31002de None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:34.876705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ad8ad-2ada-4571-8303-4105c31002de None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:34.876974 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ad8ad-2ada-4571-8303-4105c31002de None admin] PATH_INFO: `/v3/projects/c75a8d1aa0614b1aa01db2d404827c77` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:34.878228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ad8ad-2ada-4571-8303-4105c31002de None admin] RBAC: Authorizing `identity:get_project(project_id=c75a8d1aa0614b1aa01db2d404827c77)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:34.879783 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ad8ad-2ada-4571-8303-4105c31002de None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:34.886718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 228/448] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:34 2022] GET /identity/v3/projects/c75a8d1aa0614b1aa01db2d404827c77 => generated 303 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:34.889416 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ad8ad-2ada-4571-8303-4105c31002de None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:34.949205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:34.981565 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:35.016734 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58792c-d00a-403d-9f1d-b1ab83d3be21 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:35.029336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ad8ad-2ada-4571-8303-4105c31002de None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:35.066129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717bb83-71d8-40e1-b3c1-dd6902867b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:35.066749 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717bb83-71d8-40e1-b3c1-dd6902867b0f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:35.067119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717bb83-71d8-40e1-b3c1-dd6902867b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:35.067293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717bb83-71d8-40e1-b3c1-dd6902867b0f None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:35.067966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717bb83-71d8-40e1-b3c1-dd6902867b0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:35.068287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717bb83-71d8-40e1-b3c1-dd6902867b0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:35.070244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717bb83-71d8-40e1-b3c1-dd6902867b0f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:35.074744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f1d62-bfd8-4f45-92e8-19d19c14b4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:35.075484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f1d62-bfd8-4f45-92e8-19d19c14b4cb None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:35.076257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f1d62-bfd8-4f45-92e8-19d19c14b4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:35.076542 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f1d62-bfd8-4f45-92e8-19d19c14b4cb None admin] PATH_INFO: `/v3/groups/6377dcd6769240f7b51185157ee7b2ab` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:35.077882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f1d62-bfd8-4f45-92e8-19d19c14b4cb None admin] RBAC: Authorizing `identity:get_group(group_id=6377dcd6769240f7b51185157ee7b2ab)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:35.079525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f1d62-bfd8-4f45-92e8-19d19c14b4cb None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:35.079842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 221/449] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:34 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:35.081750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 229/450] 10.222.0.107 () {56 vars in 1185 bytes} [Tue Aug 23 23:11:34 2022] GET /identity/v3/groups/6377dcd6769240f7b51185157ee7b2ab => generated 227 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:35.086866 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717bb83-71d8-40e1-b3c1-dd6902867b0f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:35.088113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f1d62-bfd8-4f45-92e8-19d19c14b4cb None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:35.212802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717bb83-71d8-40e1-b3c1-dd6902867b0f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:35.213003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f1d62-bfd8-4f45-92e8-19d19c14b4cb None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:35.223537 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:35.258800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bed64a-3991-40dd-84c2-af842dba80c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:35.259442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bed64a-3991-40dd-84c2-af842dba80c1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:35.259710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bed64a-3991-40dd-84c2-af842dba80c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:35.259971 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bed64a-3991-40dd-84c2-af842dba80c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:35.260870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bed64a-3991-40dd-84c2-af842dba80c1 None admin] RBAC: Adding query filter params (group.id=6377dcd6769240f7b51185157ee7b2ab, role.id=8801d305c8374d34abe896d3b7685174, scope.project.id=c75a8d1aa0614b1aa01db2d404827c77) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:35.261068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c90bd1-3fe1-4a44-acc1-9788dbcd10fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:35.261237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bed64a-3991-40dd-84c2-af842dba80c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:35.261676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c90bd1-3fe1-4a44-acc1-9788dbcd10fe None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:35.261952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c90bd1-3fe1-4a44-acc1-9788dbcd10fe None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:35.262221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c90bd1-3fe1-4a44-acc1-9788dbcd10fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:35.262628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bed64a-3991-40dd-84c2-af842dba80c1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:35.269148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 230/451] 10.222.0.107 () {56 vars in 1381 bytes} [Tue Aug 23 23:11:35 2022] GET /identity/v3/role_assignments?group.id=6377dcd6769240f7b51185157ee7b2ab&scope.project.id=c75a8d1aa0614b1aa01db2d404827c77&role.id=8801d305c8374d34abe896d3b7685174 => generated 613 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:35.272689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:35.354539 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c90bd1-3fe1-4a44-acc1-9788dbcd10fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:35.356037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c90bd1-3fe1-4a44-acc1-9788dbcd10fe None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:35.478182 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 222/452] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:35 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:11:35.485642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bed64a-3991-40dd-84c2-af842dba80c1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:35.606897 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bed64a-3991-40dd-84c2-af842dba80c1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:35.645635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be475827-01c6-4ef9-8d77-c3237d025383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:35.646355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be475827-01c6-4ef9-8d77-c3237d025383 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:35.646624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be475827-01c6-4ef9-8d77-c3237d025383 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:35.647520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be475827-01c6-4ef9-8d77-c3237d025383 None admin] PATH_INFO: `/v3/projects/2ab98da0af85419a9eb4e9e222c7d0ea` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:35.648957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be475827-01c6-4ef9-8d77-c3237d025383 None admin] RBAC: Authorizing `identity:get_project(project_id=2ab98da0af85419a9eb4e9e222c7d0ea)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:35.650410 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be475827-01c6-4ef9-8d77-c3237d025383 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:35.652123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 231/453] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:11:35 2022] GET /identity/v3/projects/2ab98da0af85419a9eb4e9e222c7d0ea => generated 345 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:35.657955 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c90bd1-3fe1-4a44-acc1-9788dbcd10fe None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:35.702519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:35.771932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c90bd1-3fe1-4a44-acc1-9788dbcd10fe None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:35.810272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7e063-40f5-4242-aeb5-aa34729201ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:35.810900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e063-40f5-4242-aeb5-aa34729201ce None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:35.811175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e063-40f5-4242-aeb5-aa34729201ce None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:35.811441 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e063-40f5-4242-aeb5-aa34729201ce None admin] PATH_INFO: `/v3/groups/42552607c43a49dc9b2a0b446fae60c4` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:35.812553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7e063-40f5-4242-aeb5-aa34729201ce None admin] RBAC: Authorizing `identity:get_group(group_id=42552607c43a49dc9b2a0b446fae60c4)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:35.814067 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7e063-40f5-4242-aeb5-aa34729201ce None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:35.815713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 223/454] 10.222.0.107 () {56 vars in 1185 bytes} [Tue Aug 23 23:11:35 2022] GET /identity/v3/groups/42552607c43a49dc9b2a0b446fae60c4 => generated 230 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:35.821865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be475827-01c6-4ef9-8d77-c3237d025383 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:35.871752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:35.948221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be475827-01c6-4ef9-8d77-c3237d025383 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:35.999370 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e33579-451a-497e-898a-e9c1d0ba9cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:36.000003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e33579-451a-497e-898a-e9c1d0ba9cec None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:36.000285 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e33579-451a-497e-898a-e9c1d0ba9cec None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:36.000925 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e33579-451a-497e-898a-e9c1d0ba9cec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:36.001350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e33579-451a-497e-898a-e9c1d0ba9cec None admin] RBAC: Adding query filter params (group.id=42552607c43a49dc9b2a0b446fae60c4, role.id=97ece22f2e264e0e857d5107325a85d9, scope.project.id=2ab98da0af85419a9eb4e9e222c7d0ea) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:36.001661 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e33579-451a-497e-898a-e9c1d0ba9cec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:36.003346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e33579-451a-497e-898a-e9c1d0ba9cec None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:36.012141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 232/455] 10.222.0.107 () {56 vars in 1381 bytes} [Tue Aug 23 23:11:35 2022] GET /identity/v3/role_assignments?group.id=42552607c43a49dc9b2a0b446fae60c4&scope.project.id=2ab98da0af85419a9eb4e9e222c7d0ea&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 613 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:38.378238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004399c2-4d4f-48fa-9f3a-697a09e433b9 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:38.378821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004399c2-4d4f-48fa-9f3a-697a09e433b9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:38.378821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004399c2-4d4f-48fa-9f3a-697a09e433b9 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:38.380063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 224/456] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:38.387167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87062cbe-0a4f-45d1-8025-b571aed43b31 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:38.387709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87062cbe-0a4f-45d1-8025-b571aed43b31 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:38.387709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87062cbe-0a4f-45d1-8025-b571aed43b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:38.412415 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-87062cbe-0a4f-45d1-8025-b571aed43b31 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:38.414262 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-87062cbe-0a4f-45d1-8025-b571aed43b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:38.522832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 233/457] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:38.556666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9b7f7-8bb4-4329-bcff-9dddc5ab5faf None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:38.557073 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9b7f7-8bb4-4329-bcff-9dddc5ab5faf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:38.557248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9b7f7-8bb4-4329-bcff-9dddc5ab5faf None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:38.558842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 225/458] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:38.565015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fc7ad-b6dd-48c0-b785-52e840e472d4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:38.565433 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fc7ad-b6dd-48c0-b785-52e840e472d4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:38.565583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fc7ad-b6dd-48c0-b785-52e840e472d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:38.591173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-249fc7ad-b6dd-48c0-b785-52e840e472d4 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:38.592381 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-249fc7ad-b6dd-48c0-b785-52e840e472d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:38.636017 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:38.695039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 234/459] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:38.885710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b05da2-0b97-40e9-9aa2-e13651bd480a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:38.886117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b05da2-0b97-40e9-9aa2-e13651bd480a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:38.886317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b05da2-0b97-40e9-9aa2-e13651bd480a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:38.887846 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 226/460] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:38.893113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ab053-cbeb-4ae3-851a-f5ed7aaab380 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:38.893402 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ab053-cbeb-4ae3-851a-f5ed7aaab380 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:38.893682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ab053-cbeb-4ae3-851a-f5ed7aaab380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:38.921663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-261ab053-cbeb-4ae3-851a-f5ed7aaab380 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:38.923073 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-261ab053-cbeb-4ae3-851a-f5ed7aaab380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:38.939943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b05da2-0b97-40e9-9aa2-e13651bd480a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:39.037389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 235/461] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:39.104176 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b05da2-0b97-40e9-9aa2-e13651bd480a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:39.112078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:39.142638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447796e6-7ace-4e92-80ca-779f5d20e8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:39.143196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447796e6-7ace-4e92-80ca-779f5d20e8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:39.143477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447796e6-7ace-4e92-80ca-779f5d20e8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:39.143753 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447796e6-7ace-4e92-80ca-779f5d20e8c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:39.154635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447796e6-7ace-4e92-80ca-779f5d20e8c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:39.156126 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447796e6-7ace-4e92-80ca-779f5d20e8c8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:39.159543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ab053-cbeb-4ae3-851a-f5ed7aaab380 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:39.171994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-447796e6-7ace-4e92-80ca-779f5d20e8c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:39.171994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:39.171994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:39.171994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:39.171994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:39.171994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:39.171994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:39.171994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:39.171994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:39.171994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:39.171994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:39.171994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:39.171994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:39.171994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:39.171994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:39.171994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:39.173028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:39.173028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:39.173028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:39.173028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:39.173028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:39.173028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:39.173028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:39.173028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:39.173028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:39.173028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:39.173028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:39.173028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:39.173028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:39.173028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:39.173028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:39.173028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:39.173028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:39.173958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:39.173958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:39.173958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:39.173958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 227/462] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:39.180175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447796e6-7ace-4e92-80ca-779f5d20e8c8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:39.333163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:39.336277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ab053-cbeb-4ae3-851a-f5ed7aaab380 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:39.381289 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447796e6-7ace-4e92-80ca-779f5d20e8c8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:39.418995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5c10a-1c0d-4290-af80-e5aa1d6fbacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:39.419616 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5c10a-1c0d-4290-af80-e5aa1d6fbacb None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:39.419824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5c10a-1c0d-4290-af80-e5aa1d6fbacb None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:39.420091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5c10a-1c0d-4290-af80-e5aa1d6fbacb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:39.433850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5c10a-1c0d-4290-af80-e5aa1d6fbacb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:39.436270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5c10a-1c0d-4290-af80-e5aa1d6fbacb None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:39.452449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8043ad-8e35-49a8-9d28-5f47f644715a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:39.453330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-6ee5c10a-1c0d-4290-af80-e5aa1d6fbacb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:39.453330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:39.453330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:39.453330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:39.453330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:39.453330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:39.453330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:39.453330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:39.453330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:39.453330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:39.453330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:39.453330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:39.453330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:39.453330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:39.453330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:39.453330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:39.455040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:39.455040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:39.455040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:39.455040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:39.455040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:39.455040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:39.455040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:39.455040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:39.455040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:39.455040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:39.455040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:39.455040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:39.455040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:39.455040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:39.455040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:39.455040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:39.455040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:39.456901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:39.456901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:39.456901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:39.458089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8043ad-8e35-49a8-9d28-5f47f644715a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:39.459339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8043ad-8e35-49a8-9d28-5f47f644715a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:39.460042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 236/463] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:11:39.460876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5c10a-1c0d-4290-af80-e5aa1d6fbacb None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:39.461359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8043ad-8e35-49a8-9d28-5f47f644715a None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:39.462757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8043ad-8e35-49a8-9d28-5f47f644715a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:39.463279 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8043ad-8e35-49a8-9d28-5f47f644715a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:39.466119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8043ad-8e35-49a8-9d28-5f47f644715a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:39.489997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 228/464] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:39.492268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8043ad-8e35-49a8-9d28-5f47f644715a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:39.515821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:39.572260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5c10a-1c0d-4290-af80-e5aa1d6fbacb None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:39.606282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8043ad-8e35-49a8-9d28-5f47f644715a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:39.614332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8352f8e-abdc-45e3-a281-37b0126db51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:39.614824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8352f8e-abdc-45e3-a281-37b0126db51f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:39.615111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8352f8e-abdc-45e3-a281-37b0126db51f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:39.615364 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8352f8e-abdc-45e3-a281-37b0126db51f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:39.628539 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8352f8e-abdc-45e3-a281-37b0126db51f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:39.630127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8352f8e-abdc-45e3-a281-37b0126db51f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:39.638959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:39.650346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a8352f8e-abdc-45e3-a281-37b0126db51f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:39.650346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:39.650346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:39.650346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:39.650346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:39.650346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:39.650346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:39.650346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:39.650346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:39.650346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:39.650346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:39.650346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:39.650346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:39.650346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:39.650346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:39.650346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:39.651294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:39.651294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:39.651294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:39.651294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:39.651294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:39.651294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:39.651294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:39.651294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:39.651294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:39.651294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:39.651294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:39.651294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:39.651294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:39.651294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:39.651294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:39.651294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:39.651294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:39.652349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:39.652349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:39.652349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:39.652349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 237/465] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:39.652349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8352f8e-abdc-45e3-a281-37b0126db51f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:39.660663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b29dc-0c49-4f67-ac4b-f1e633c81c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:39.661306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b29dc-0c49-4f67-ac4b-f1e633c81c81 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:39.661572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b29dc-0c49-4f67-ac4b-f1e633c81c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:39.661844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b29dc-0c49-4f67-ac4b-f1e633c81c81 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:39.662480 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b29dc-0c49-4f67-ac4b-f1e633c81c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:39.663230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b29dc-0c49-4f67-ac4b-f1e633c81c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:39.664675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b29dc-0c49-4f67-ac4b-f1e633c81c81 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:39.682270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 229/466] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:39.682270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be70b1-f5ce-48c6-8a6f-c827e04ec90c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:39.682270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be70b1-f5ce-48c6-8a6f-c827e04ec90c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:39.682545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be70b1-f5ce-48c6-8a6f-c827e04ec90c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:39.690709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 230/467] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:39.690709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be70b1-f5ce-48c6-8a6f-c827e04ec90c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:39.781384 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8352f8e-abdc-45e3-a281-37b0126db51f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:39.794791 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:39.823121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b942e-17d3-4fa8-ae9f-0dedff9eff87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:39.824163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b942e-17d3-4fa8-ae9f-0dedff9eff87 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:39.824557 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b942e-17d3-4fa8-ae9f-0dedff9eff87 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:39.825372 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b942e-17d3-4fa8-ae9f-0dedff9eff87 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:39.826146 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b942e-17d3-4fa8-ae9f-0dedff9eff87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:39.827977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b942e-17d3-4fa8-ae9f-0dedff9eff87 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:39.837292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be70b1-f5ce-48c6-8a6f-c827e04ec90c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:39.854025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 238/468] 10.222.0.107 () {60 vars in 1137 bytes} [Tue Aug 23 23:11:39 2022] POST /identity/v3/users => generated 247 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:11:39.855064 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b942e-17d3-4fa8-ae9f-0dedff9eff87 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:39.880950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d6fd3-6f3d-4352-9600-bddc42f34285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:39.881941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d6fd3-6f3d-4352-9600-bddc42f34285 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:39.882434 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d6fd3-6f3d-4352-9600-bddc42f34285 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:39.882974 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d6fd3-6f3d-4352-9600-bddc42f34285 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:39.884006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d6fd3-6f3d-4352-9600-bddc42f34285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:39.884506 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d6fd3-6f3d-4352-9600-bddc42f34285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:39.886149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d6fd3-6f3d-4352-9600-bddc42f34285 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:39.901751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 231/469] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:39.903506 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f0e9e-9e9a-4d42-ad3b-09565640f66e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:39.903964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f0e9e-9e9a-4d42-ad3b-09565640f66e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:39.904576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f0e9e-9e9a-4d42-ad3b-09565640f66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:39.925886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7c1f0e9e-9e9a-4d42-ad3b-09565640f66e None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:39.927508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7c1f0e9e-9e9a-4d42-ad3b-09565640f66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:39.953118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:40.026661 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 232/470] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:40.027179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b942e-17d3-4fa8-ae9f-0dedff9eff87 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:40.027836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f0e9e-9e9a-4d42-ad3b-09565640f66e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:40.066592 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b30ec7-9961-4c69-ac08-185d35d49e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:40.067465 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b30ec7-9961-4c69-ac08-185d35d49e7b None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:40.067944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b30ec7-9961-4c69-ac08-185d35d49e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:40.068382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b30ec7-9961-4c69-ac08-185d35d49e7b None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:40.069295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b30ec7-9961-4c69-ac08-185d35d49e7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:40.071639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b30ec7-9961-4c69-ac08-185d35d49e7b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:40.100807 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 239/471] 10.222.0.107 () {60 vars in 1137 bytes} [Tue Aug 23 23:11:39 2022] POST /identity/v3/users => generated 249 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:11:40.108414 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00784db9-f63b-45e7-82c8-eed366987dcc None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:40.109575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00784db9-f63b-45e7-82c8-eed366987dcc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:40.110016 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00784db9-f63b-45e7-82c8-eed366987dcc None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:40.112684 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 240/472] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:40 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:40.119033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657f8a6-21a3-4097-90ce-3b3d8961807e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:40.119720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657f8a6-21a3-4097-90ce-3b3d8961807e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:40.119720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657f8a6-21a3-4097-90ce-3b3d8961807e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:40.125380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:40.141053 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d657f8a6-21a3-4097-90ce-3b3d8961807e None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:40.142276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d657f8a6-21a3-4097-90ce-3b3d8961807e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:40.179748 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f0e9e-9e9a-4d42-ad3b-09565640f66e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:40.225987 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 241/473] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 23 23:11:40.233375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f1b2e-8c48-44d2-a599-42c7a0a43fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:40.233992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f1b2e-8c48-44d2-a599-42c7a0a43fe9 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:40.234271 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f1b2e-8c48-44d2-a599-42c7a0a43fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:40.234541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f1b2e-8c48-44d2-a599-42c7a0a43fe9 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:40.235187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f1b2e-8c48-44d2-a599-42c7a0a43fe9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:40.237747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f1b2e-8c48-44d2-a599-42c7a0a43fe9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:40.262979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 233/474] 10.222.0.107 () {60 vars in 1137 bytes} [Tue Aug 23 23:11:40 2022] POST /identity/v3/users => generated 249 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:11:40.332347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657f8a6-21a3-4097-90ce-3b3d8961807e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:40.395975 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:40.467103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657f8a6-21a3-4097-90ce-3b3d8961807e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:40.511142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5af9a-69a7-4db7-9764-db92da05a719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:40.511716 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5af9a-69a7-4db7-9764-db92da05a719 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:40.511972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5af9a-69a7-4db7-9764-db92da05a719 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:40.512240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5af9a-69a7-4db7-9764-db92da05a719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:40.519977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f1b2e-8c48-44d2-a599-42c7a0a43fe9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:40.524636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5af9a-69a7-4db7-9764-db92da05a719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:40.526123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5af9a-69a7-4db7-9764-db92da05a719 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:40.545266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-dcc5af9a-69a7-4db7-9764-db92da05a719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:40.545266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:40.545266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:40.545266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:40.545266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:40.545266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:40.545266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:40.545266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:40.545266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:40.545266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:40.545266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:40.545266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:40.545266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:40.545266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:40.545266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:40.545266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:40.546212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:40.546212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:40.546212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:40.546212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:40.546212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:40.546212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:40.546212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:40.546212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:40.546212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:40.546212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:40.546212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:40.546212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:40.546212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:40.546212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:40.546212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:40.546212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:40.546212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:40.547561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:40.547561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:40.547561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:40.547561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 242/475] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:40.553686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5af9a-69a7-4db7-9764-db92da05a719 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:40.665879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:40.675853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5af9a-69a7-4db7-9764-db92da05a719 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:40.682458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f1b2e-8c48-44d2-a599-42c7a0a43fe9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:40.708924 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:40.712261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a429c6-27f0-469c-a4f1-cd0ff2e51ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:40.713035 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a429c6-27f0-469c-a4f1-cd0ff2e51ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:40.713429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a429c6-27f0-469c-a4f1-cd0ff2e51ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:40.713793 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a429c6-27f0-469c-a4f1-cd0ff2e51ac4 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:40.714528 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a429c6-27f0-469c-a4f1-cd0ff2e51ac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:40.714934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a429c6-27f0-469c-a4f1-cd0ff2e51ac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:40.716428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a429c6-27f0-469c-a4f1-cd0ff2e51ac4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:40.724173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68f2fa-a735-4570-bb46-f6d047688ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:40.725814 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68f2fa-a735-4570-bb46-f6d047688ab4 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:40.726363 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68f2fa-a735-4570-bb46-f6d047688ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:40.726834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68f2fa-a735-4570-bb46-f6d047688ab4 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:40.727742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68f2fa-a735-4570-bb46-f6d047688ab4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:40.734564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68f2fa-a735-4570-bb46-f6d047688ab4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:40.735944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 243/476] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:40.738332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a429c6-27f0-469c-a4f1-cd0ff2e51ac4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:40.757861 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.sql.core [None req-7a68f2fa-a735-4570-bb46-f6d047688ab4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 23:11:40.757861 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 23:11:40.757861 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [parameters: {'id': 'ad99f7afcc824dfba560bef9b613017a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 23:11:40.757861 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81437) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 23:11:40.783455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-7a68f2fa-a735-4570-bb46-f6d047688ab4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 23:11:40.783455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:40.783455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:11:40.783455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:11:40.783455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:11:40.783455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:11:40.783455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:11:40.783455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:11:40.783455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:11:40.783455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:11:40.783455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:11:40.783455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:11:40.783455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:11:40.783455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application result.read() Aug 23 23:11:40.783455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:11:40.784369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:11:40.784369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:11:40.784369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:11:40.784369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:11:40.784369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:11:40.784369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:11:40.784369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:11:40.784369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 23:11:40.784369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:40.784369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 23:11:40.784369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:40.784369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:40.784369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 23:11:40.784369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 23:11:40.784369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 23 23:11:40.784369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return ref.to_dict() Aug 23 23:11:40.784369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:11:40.784369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:11:40.785309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 23:11:40.785309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application yield resource Aug 23 23:11:40.785309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:11:40.785309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:11:40.785309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 23:11:40.785309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 23:11:40.785309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 23:11:40.785309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 23:11:40.785309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 23:11:40.785309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise self.value Aug 23 23:11:40.785309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 23:11:40.785309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 23:11:40.785309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 23:11:40.785309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application session.commit() Aug 23 23:11:40.785309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 23:11:40.785309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 23:11:40.785309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 23:11:40.786172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 23:11:40.786172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 23:11:40.786172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.session.flush() Aug 23 23:11:40.786172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 23:11:40.786172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 23:11:40.786172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 23:11:40.786172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 23:11:40.786172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 23:11:40.786172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application compat.raise_( Aug 23 23:11:40.786172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:11:40.786172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception Aug 23 23:11:40.786172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 23:11:40.786172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 23:11:40.786172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 23:11:40.786172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 23:11:40.786172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 23:11:40.786172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 23:11:40.787072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 23:11:40.787072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 23:11:40.787072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 23:11:40.787072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 23:11:40.787072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 23:11:40.787072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 23:11:40.787072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 23:11:40.787072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 23:11:40.787072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 23:11:40.787072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 23:11:40.787072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 23:11:40.787072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 23:11:40.787072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 23:11:40.787072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 23:11:40.787072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:11:40.787072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception Aug 23 23:11:40.788501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:11:40.788501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:11:40.788501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:11:40.788501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:11:40.788501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:11:40.788501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:11:40.788501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:11:40.788501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:11:40.788501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:11:40.788501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:11:40.788501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:11:40.788501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application result.read() Aug 23 23:11:40.788501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:11:40.788501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:11:40.788501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:11:40.788501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:11:40.797737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:11:40.797737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:11:40.797737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:11:40.797737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:11:40.797737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 23:11:40.797737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 23:11:40.797737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [parameters: {'id': 'ad99f7afcc824dfba560bef9b613017a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 23:11:40.797737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 23:11:40.797737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:40.797737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:11:40.797737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:40.797737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:40.797737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:40.797737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:40.797737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:40.797737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:40.798756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:40.798756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:40.798756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:40.798756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:40.798756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:40.798756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:40.798756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 23 23:11:40.798756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 23 23:11:40.798756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:40.798756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:40.798756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 23 23:11:40.798756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 23 23:11:40.798756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 23:11:40.798756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 23:11:40.798756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 23:11:40.798756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:40.801671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 234/477] 10.222.0.107 () {60 vars in 1136 bytes} [Tue Aug 23 23:11:40 2022] POST /identity/v3/roles => generated 144 bytes in 282 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:40.807171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68f2fa-a735-4570-bb46-f6d047688ab4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:40.853799 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a429c6-27f0-469c-a4f1-cd0ff2e51ac4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:40.901683 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b8b4d-ac1d-473a-99ae-bc7ed0420051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:40.902521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b8b4d-ac1d-473a-99ae-bc7ed0420051 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:40.902909 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b8b4d-ac1d-473a-99ae-bc7ed0420051 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:40.903298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b8b4d-ac1d-473a-99ae-bc7ed0420051 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:40.904055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b8b4d-ac1d-473a-99ae-bc7ed0420051 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:40.905815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b8b4d-ac1d-473a-99ae-bc7ed0420051 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:40.952769 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 244/478] 10.222.0.107 () {60 vars in 1137 bytes} [Tue Aug 23 23:11:40 2022] POST /identity/v3/users => generated 250 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:11:41.040275 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68f2fa-a735-4570-bb46-f6d047688ab4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:41.086217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbf4a9-d8a9-48ee-aec1-c16e8339220a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:41.087186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbf4a9-d8a9-48ee-aec1-c16e8339220a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:41.087653 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbf4a9-d8a9-48ee-aec1-c16e8339220a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:41.088072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbf4a9-d8a9-48ee-aec1-c16e8339220a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:41.102039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbf4a9-d8a9-48ee-aec1-c16e8339220a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:41.107998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f4bbf4a9-d8a9-48ee-aec1-c16e8339220a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:41.107998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:41.107998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:41.107998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:41.107998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:41.107998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:41.107998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:41.107998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:41.107998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:41.107998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:41.107998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:41.107998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:41.107998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:41.107998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:41.107998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:41.107998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:41.109650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:41.109650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:41.109650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:41.109650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:41.109650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:41.109650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:41.109650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:41.109650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:41.109650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:41.109650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:41.109650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:41.109650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:41.109650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:41.109650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:41.109650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:41.109650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:41.110634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:41.110634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:41.110634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:41.110634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:41.110634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:41.110634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:41.110634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:41.110634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:41.110634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:41.110634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:41.110634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:11:41.110634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:41.113078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 235/479] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:11:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:11:41.119392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b8b4d-ac1d-473a-99ae-bc7ed0420051 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:41.142422 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:41.257548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b8b4d-ac1d-473a-99ae-bc7ed0420051 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:41.299127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08efae3-e5b7-4e8b-a2b1-ad0ea3d419ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:41.299663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08efae3-e5b7-4e8b-a2b1-ad0ea3d419ca None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:41.299939 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08efae3-e5b7-4e8b-a2b1-ad0ea3d419ca None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:41.300208 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08efae3-e5b7-4e8b-a2b1-ad0ea3d419ca None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:41.301001 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08efae3-e5b7-4e8b-a2b1-ad0ea3d419ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:41.301306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08efae3-e5b7-4e8b-a2b1-ad0ea3d419ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:41.302691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08efae3-e5b7-4e8b-a2b1-ad0ea3d419ca None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:41.313006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 245/480] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:41 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:42.489211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21a3a8-959e-44ad-bbd5-bc4afebfdedd None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:42.490263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21a3a8-959e-44ad-bbd5-bc4afebfdedd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:42.490263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21a3a8-959e-44ad-bbd5-bc4afebfdedd None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:42.492218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 236/481] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:42.498648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e906200-e733-47ce-ae67-e551a8d0c6c0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:42.499607 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e906200-e733-47ce-ae67-e551a8d0c6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:42.499607 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e906200-e733-47ce-ae67-e551a8d0c6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:42.529686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3e906200-e733-47ce-ae67-e551a8d0c6c0 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:42.530907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3e906200-e733-47ce-ae67-e551a8d0c6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:42.635716 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:42.641901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 246/482] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:42.766912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752de9e7-4ec6-4a83-964d-e1455df4001a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:42.767303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752de9e7-4ec6-4a83-964d-e1455df4001a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:42.767556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752de9e7-4ec6-4a83-964d-e1455df4001a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:42.769012 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 237/483] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:11:42.774988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cafa7d-101b-4213-8b96-5b0e13aaf2c5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:42.775359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cafa7d-101b-4213-8b96-5b0e13aaf2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:42.775592 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cafa7d-101b-4213-8b96-5b0e13aaf2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:42.805907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d7cafa7d-101b-4213-8b96-5b0e13aaf2c5 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:42.807162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d7cafa7d-101b-4213-8b96-5b0e13aaf2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:42.860101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5ea72-1dd4-4a72-9e44-64d305836d4a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:42.860503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5ea72-1dd4-4a72-9e44-64d305836d4a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:42.860771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5ea72-1dd4-4a72-9e44-64d305836d4a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:42.862285 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 238/484] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:42.869848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbd553-4791-4402-8355-dd45f62e5f19 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:42.870728 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbd553-4791-4402-8355-dd45f62e5f19 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:42.871506 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbd553-4791-4402-8355-dd45f62e5f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:42.898753 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 247/485] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:42.917055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e3cbd553-4791-4402-8355-dd45f62e5f19 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:42.918946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e3cbd553-4791-4402-8355-dd45f62e5f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:42.991977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:43.034653 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 239/486] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:43.134100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cafa7d-101b-4213-8b96-5b0e13aaf2c5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:43.181923 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbd553-4791-4402-8355-dd45f62e5f19 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:43.276031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cafa7d-101b-4213-8b96-5b0e13aaf2c5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:43.331877 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:43.338945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac6a6c-850f-4cf2-a5c2-7550702feee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:43.339599 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac6a6c-850f-4cf2-a5c2-7550702feee0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:43.339880 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac6a6c-850f-4cf2-a5c2-7550702feee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:43.340156 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac6a6c-850f-4cf2-a5c2-7550702feee0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:43.354463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbd553-4791-4402-8355-dd45f62e5f19 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:43.366321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac6a6c-850f-4cf2-a5c2-7550702feee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:43.371186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-3cac6a6c-850f-4cf2-a5c2-7550702feee0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:43.371186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:43.371186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:43.371186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:43.371186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:43.371186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:43.371186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:43.371186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:43.371186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:43.371186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:43.371186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:43.371186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:43.371186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:43.371186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:43.371186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:43.371186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:43.372115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:43.372115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:43.372115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:43.372115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:43.372115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:43.372115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:43.372115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:43.372115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:43.372115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:43.372115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:43.372115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:43.372115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:43.372115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:43.372115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:43.372115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:43.372115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:43.372950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:43.372950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:43.372950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:43.372950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:43.372950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:43.372950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:43.372950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:43.372950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:43.372950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:43.372950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:43.372950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:43.372950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:43.376733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 248/487] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:11:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:43.381225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac6a6c-850f-4cf2-a5c2-7550702feee0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:43.416243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7baca-cfb3-4d95-af66-eb8baed342b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:43.417569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7baca-cfb3-4d95-af66-eb8baed342b7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:43.418016 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7baca-cfb3-4d95-af66-eb8baed342b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:43.418487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7baca-cfb3-4d95-af66-eb8baed342b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:43.438946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7baca-cfb3-4d95-af66-eb8baed342b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:43.448718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-40c7baca-cfb3-4d95-af66-eb8baed342b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:43.448718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:43.448718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:43.448718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:43.448718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:43.448718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:43.448718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:43.448718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:43.448718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:43.448718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:43.448718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:43.448718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:43.448718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:43.448718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:43.448718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:43.448718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:43.451111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:43.451111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:43.451111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:43.451111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:43.451111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:43.451111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:43.451111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:43.451111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:43.451111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:43.451111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:43.451111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:43.451111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:43.451111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:43.451111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:43.451111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:43.451111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:43.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:43.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:43.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:43.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:43.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:43.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:43.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:43.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:43.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:43.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:43.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:43.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:43.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 240/488] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:11:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:11:43.460878 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7baca-cfb3-4d95-af66-eb8baed342b7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:43.519736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:43.583759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac6a6c-850f-4cf2-a5c2-7550702feee0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:43.602253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7baca-cfb3-4d95-af66-eb8baed342b7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:43.632057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012a647-96fd-4473-b827-09efed10c0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:43.632750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012a647-96fd-4473-b827-09efed10c0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:43.633034 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012a647-96fd-4473-b827-09efed10c0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:43.633310 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012a647-96fd-4473-b827-09efed10c0f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:43.633996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012a647-96fd-4473-b827-09efed10c0f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:43.634300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012a647-96fd-4473-b827-09efed10c0f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:43.635715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012a647-96fd-4473-b827-09efed10c0f2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:43.646136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 249/489] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:43 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:43.646136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012a647-96fd-4473-b827-09efed10c0f2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:43.677729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10d96c-a12a-452a-a077-7fac55f34e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:43.678807 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10d96c-a12a-452a-a077-7fac55f34e29 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:43.679264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10d96c-a12a-452a-a077-7fac55f34e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:43.679671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10d96c-a12a-452a-a077-7fac55f34e29 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:43.680521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10d96c-a12a-452a-a077-7fac55f34e29 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:43.681025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10d96c-a12a-452a-a077-7fac55f34e29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:43.682767 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10d96c-a12a-452a-a077-7fac55f34e29 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:43.694704 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 241/490] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:43 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:43.701352 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169abcc4-6422-46a2-b863-205e1d5bec98 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:43.701655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169abcc4-6422-46a2-b863-205e1d5bec98 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:43.701917 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169abcc4-6422-46a2-b863-205e1d5bec98 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:43.703293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 242/491] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:43.704075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169abcc4-6422-46a2-b863-205e1d5bec98 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:43.725109 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:43.794970 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012a647-96fd-4473-b827-09efed10c0f2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:43.837152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5cfb1-734b-4686-a722-7dac1a03ec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:43.837703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5cfb1-734b-4686-a722-7dac1a03ec51 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:43.837979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5cfb1-734b-4686-a722-7dac1a03ec51 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:43.838257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5cfb1-734b-4686-a722-7dac1a03ec51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:43.841083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:43.846658 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169abcc4-6422-46a2-b863-205e1d5bec98 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:43.852458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5cfb1-734b-4686-a722-7dac1a03ec51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:43.861757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-3ec5cfb1-734b-4686-a722-7dac1a03ec51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:43.861757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:43.861757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:43.861757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:43.861757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:43.861757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:43.861757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:43.861757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:43.861757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:43.861757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:43.861757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:43.861757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:43.861757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:43.861757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:43.861757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:43.861757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:43.862958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:43.862958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:43.862958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:43.862958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:43.862958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:43.862958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:43.862958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:43.862958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:43.862958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:43.862958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:43.862958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:43.862958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:43.862958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:43.862958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:43.862958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:43.862958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:43.863888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:43.863888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:43.863888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:43.863888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:43.863888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:43.863888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:43.863888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:43.863888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:43.863888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:43.863888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:43.863888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:43.863888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:43.863888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 250/492] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:11:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:43.864812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5cfb1-734b-4686-a722-7dac1a03ec51 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:43.893413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e534a-f371-4d48-9403-db8130bf959c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:43.894094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e534a-f371-4d48-9403-db8130bf959c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:43.894368 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e534a-f371-4d48-9403-db8130bf959c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:43.894639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e534a-f371-4d48-9403-db8130bf959c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:43.908100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e534a-f371-4d48-9403-db8130bf959c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:43.909793 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e534a-f371-4d48-9403-db8130bf959c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:43.929129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4d5e534a-f371-4d48-9403-db8130bf959c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:43.929129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:43.929129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:43.929129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:43.929129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:43.929129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:43.929129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:43.929129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:43.929129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:43.929129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:43.929129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:43.929129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:43.929129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:43.929129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:43.929129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:43.929129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:43.930438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:43.930438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:43.930438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:43.930438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:43.930438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:43.930438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:43.930438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:43.930438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:43.930438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:43.930438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:43.930438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:43.930438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:43.930438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:43.930438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:43.930438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:43.930438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:43.930438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:43.931359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:43.931359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:43.931359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:43.931359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 243/493] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:43.931582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22720f-e97a-42a1-a59e-461c20622494 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:43.932293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22720f-e97a-42a1-a59e-461c20622494 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:43.932293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22720f-e97a-42a1-a59e-461c20622494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:43.968253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2e22720f-e97a-42a1-a59e-461c20622494 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:43.969992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2e22720f-e97a-42a1-a59e-461c20622494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:44.010974 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5cfb1-734b-4686-a722-7dac1a03ec51 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:44.027250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:44.055400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9b4e4-47c7-40e4-ae98-9fb7ef5a807a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:44.056179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9b4e4-47c7-40e4-ae98-9fb7ef5a807a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:44.056341 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9b4e4-47c7-40e4-ae98-9fb7ef5a807a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:44.056579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9b4e4-47c7-40e4-ae98-9fb7ef5a807a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:44.076881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9b4e4-47c7-40e4-ae98-9fb7ef5a807a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:44.078373 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9b4e4-47c7-40e4-ae98-9fb7ef5a807a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:44.080301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 244/494] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:44.081845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22720f-e97a-42a1-a59e-461c20622494 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:44.110429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-61f9b4e4-47c7-40e4-ae98-9fb7ef5a807a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:44.110429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:44.110429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:44.110429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:44.110429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:44.110429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:44.110429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:44.110429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:44.110429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:44.110429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:44.110429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:44.110429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:44.110429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:44.110429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:44.110429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:44.110429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:44.111349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:44.111349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:44.111349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:44.111349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:44.111349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:44.111349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:44.111349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:44.111349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:44.111349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:44.111349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:44.111349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:44.111349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:44.111349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:44.111349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:44.111349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:44.111349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:44.111349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:44.112189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:44.112189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:44.112189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:44.112189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 251/495] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:44.112962 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9b4e4-47c7-40e4-ae98-9fb7ef5a807a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:44.199159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:44.226829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22720f-e97a-42a1-a59e-461c20622494 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:44.255341 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9b4e4-47c7-40e4-ae98-9fb7ef5a807a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:44.280096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6b2d2-2e6b-4d8b-9934-c489d6c9a339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:44.280935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6b2d2-2e6b-4d8b-9934-c489d6c9a339 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:44.281072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6b2d2-2e6b-4d8b-9934-c489d6c9a339 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:44.281268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6b2d2-2e6b-4d8b-9934-c489d6c9a339 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:44.282219 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6b2d2-2e6b-4d8b-9934-c489d6c9a339 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:44.282530 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6b2d2-2e6b-4d8b-9934-c489d6c9a339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:44.283943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6b2d2-2e6b-4d8b-9934-c489d6c9a339 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:44.294701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 245/496] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:44 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:44.295838 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6b2d2-2e6b-4d8b-9934-c489d6c9a339 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:44.304572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31b5aa-f15b-4dfe-86d9-a5e2414c50d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:44.305619 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31b5aa-f15b-4dfe-86d9-a5e2414c50d5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:44.305902 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31b5aa-f15b-4dfe-86d9-a5e2414c50d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:44.306199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31b5aa-f15b-4dfe-86d9-a5e2414c50d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:44.306821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31b5aa-f15b-4dfe-86d9-a5e2414c50d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:44.307122 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31b5aa-f15b-4dfe-86d9-a5e2414c50d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:44.308525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31b5aa-f15b-4dfe-86d9-a5e2414c50d5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:44.324823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 252/497] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:44.326591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c422d34-d877-44bf-b3e2-179fb377700c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:44.327078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c422d34-d877-44bf-b3e2-179fb377700c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:44.327554 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c422d34-d877-44bf-b3e2-179fb377700c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:44.333365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 253/498] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:44 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:44.334628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c422d34-d877-44bf-b3e2-179fb377700c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:44.362513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:44.422223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6b2d2-2e6b-4d8b-9934-c489d6c9a339 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:44.454323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c422d34-d877-44bf-b3e2-179fb377700c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:44.466337 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7050585-3fb4-48c6-87d6-bd2d864ebfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:44.466950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7050585-3fb4-48c6-87d6-bd2d864ebfdf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:44.467226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7050585-3fb4-48c6-87d6-bd2d864ebfdf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:44.467494 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7050585-3fb4-48c6-87d6-bd2d864ebfdf None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:44.468141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7050585-3fb4-48c6-87d6-bd2d864ebfdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:44.468440 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7050585-3fb4-48c6-87d6-bd2d864ebfdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:44.469868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7050585-3fb4-48c6-87d6-bd2d864ebfdf None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:44.485766 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 246/499] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:44.486629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7050585-3fb4-48c6-87d6-bd2d864ebfdf None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:44.491566 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:44.507382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c5891-cd9f-4657-867d-68630e539168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:44.508184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c5891-cd9f-4657-867d-68630e539168 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:44.508456 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c5891-cd9f-4657-867d-68630e539168 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:44.508871 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c5891-cd9f-4657-867d-68630e539168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:44.522953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c5891-cd9f-4657-867d-68630e539168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:44.524546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c5891-cd9f-4657-867d-68630e539168 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:44.541057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-1a5c5891-cd9f-4657-867d-68630e539168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:44.541057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:44.541057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:44.541057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:44.541057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:44.541057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:44.541057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:44.541057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:44.541057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:44.541057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:44.541057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:44.541057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:44.541057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:44.541057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:44.541057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:44.541057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:44.542043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:44.542043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:44.542043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:44.542043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:44.542043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:44.542043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:44.542043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:44.542043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:44.542043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:44.542043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:44.542043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:44.542043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:44.542043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:44.542043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:44.542043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:44.542043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:44.542043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:44.543188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:44.543188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:44.543188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:44.543188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 254/500] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:44.543868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09fb9e-65b4-405a-92f4-00e3b3e213cf None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:44.544136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09fb9e-65b4-405a-92f4-00e3b3e213cf None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:44.544409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09fb9e-65b4-405a-92f4-00e3b3e213cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:44.563391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6d09fb9e-65b4-405a-92f4-00e3b3e213cf None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:44.564644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6d09fb9e-65b4-405a-92f4-00e3b3e213cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:44.599033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7050585-3fb4-48c6-87d6-bd2d864ebfdf None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:44.636258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 255/501] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:44.637054 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09fb9e-65b4-405a-92f4-00e3b3e213cf None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:44.637875 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ad445-47bf-4af8-9aec-815647cdd92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:44.638516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ad445-47bf-4af8-9aec-815647cdd92e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:44.638791 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ad445-47bf-4af8-9aec-815647cdd92e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:44.639072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ad445-47bf-4af8-9aec-815647cdd92e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:44.647045 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ad445-47bf-4af8-9aec-815647cdd92e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:44.648534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ad445-47bf-4af8-9aec-815647cdd92e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:44.654621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:44.663353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-5f6ad445-47bf-4af8-9aec-815647cdd92e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:11:44.663353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:44.663353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:44.663353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:44.663353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:44.663353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:44.663353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:44.663353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:44.663353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:44.663353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:44.663353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:44.663353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:44.663353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:11:44.663353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:11:44.663353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:11:44.663353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:11:44.664430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:44.664430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:44.664430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:11:44.664430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:44.664430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:11:44.664430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:44.664430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:44.664430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:44.664430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:44.664430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:44.664430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:44.664430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:44.664430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:44.664430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:44.664430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:44.664430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:44.664430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:44.664430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:44.665634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:44.665634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:44.665634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:11:44.665634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:11:44.665634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:11:44.665634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:11:44.665634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:11:44.665634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:11:44.665634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:11:44.665634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:44.669815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 247/502] 10.222.0.107 () {56 vars in 1098 bytes} [Tue Aug 23 23:11:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:44.670673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ad445-47bf-4af8-9aec-815647cdd92e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:44.749530 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:44.772874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09fb9e-65b4-405a-92f4-00e3b3e213cf None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:44.793811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ad445-47bf-4af8-9aec-815647cdd92e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:44.813119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828a287-6745-4341-b46e-79032bd43726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:44.814311 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828a287-6745-4341-b46e-79032bd43726 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:44.814882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828a287-6745-4341-b46e-79032bd43726 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:44.815265 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828a287-6745-4341-b46e-79032bd43726 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:44.832095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18843f89-81bf-4bab-bb8b-b92486245961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:44.832823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18843f89-81bf-4bab-bb8b-b92486245961 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:44.833160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18843f89-81bf-4bab-bb8b-b92486245961 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:44.833505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18843f89-81bf-4bab-bb8b-b92486245961 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:44.833912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828a287-6745-4341-b46e-79032bd43726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:44.843663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18843f89-81bf-4bab-bb8b-b92486245961 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:44.844135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a828a287-6745-4341-b46e-79032bd43726 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:44.844135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:44.844135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:44.844135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:44.844135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:44.844135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:44.844135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:44.844135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:44.844135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:44.844135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:44.844135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:44.844135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:44.844135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:44.844135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:44.844135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:44.844135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:44.845231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:44.845231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:44.845231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:44.845231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:44.845231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:44.845231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:44.845231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:44.845231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:44.845231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:44.845231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:44.845231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:44.845231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:44.845231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:44.845231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:44.845231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:44.845231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:44.846215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:44.846215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:44.846215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:44.846215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:44.846215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:44.846215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:44.846215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:44.846215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:44.846215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:44.846215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:44.846215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:44.846215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:44.846840 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18843f89-81bf-4bab-bb8b-b92486245961 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:44.848652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 256/503] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:11:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:44.849904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828a287-6745-4341-b46e-79032bd43726 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:44.863303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-18843f89-81bf-4bab-bb8b-b92486245961 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:11:44.863303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:44.863303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:44.863303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:44.863303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:44.863303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:44.863303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:44.863303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:44.863303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:44.863303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:44.863303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:44.863303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:44.863303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:11:44.863303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:11:44.863303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:11:44.863303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:11:44.864306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:44.864306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:44.864306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:11:44.864306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:44.864306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:11:44.864306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:44.864306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:44.864306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:44.864306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:44.864306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:44.864306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:44.864306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:44.864306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:44.864306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:44.864306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:44.864306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:44.864306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:44.864306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:44.865268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:44.865268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:44.865268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:11:44.865268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:11:44.865268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:11:44.865268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:11:44.865268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:11:44.865268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:11:44.865268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:11:44.865268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:44.865268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 248/504] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:44.865268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18843f89-81bf-4bab-bb8b-b92486245961 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:44.948992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:44.982358 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828a287-6745-4341-b46e-79032bd43726 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:45.002711 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18843f89-81bf-4bab-bb8b-b92486245961 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:45.019532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af550a-4ab2-4f47-a0c8-7de9ced78608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:45.020377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af550a-4ab2-4f47-a0c8-7de9ced78608 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:45.020377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af550a-4ab2-4f47-a0c8-7de9ced78608 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:45.020680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af550a-4ab2-4f47-a0c8-7de9ced78608 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:45.021318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af550a-4ab2-4f47-a0c8-7de9ced78608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:45.021619 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af550a-4ab2-4f47-a0c8-7de9ced78608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:45.023063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af550a-4ab2-4f47-a0c8-7de9ced78608 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:45.028491 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:45.035472 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 257/505] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:45.037437 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af550a-4ab2-4f47-a0c8-7de9ced78608 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:45.040848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ae692-55ce-4912-8549-1f43ac064ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:45.041484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ae692-55ce-4912-8549-1f43ac064ddd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:45.041764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ae692-55ce-4912-8549-1f43ac064ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:45.042030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ae692-55ce-4912-8549-1f43ac064ddd None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:45.043038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ae692-55ce-4912-8549-1f43ac064ddd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:45.043341 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ae692-55ce-4912-8549-1f43ac064ddd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:45.044870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ae692-55ce-4912-8549-1f43ac064ddd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:45.083184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 249/506] 10.222.0.107 () {56 vars in 1138 bytes} [Tue Aug 23 23:11:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:45.084036 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ae692-55ce-4912-8549-1f43ac064ddd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:45.140623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af550a-4ab2-4f47-a0c8-7de9ced78608 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:45.166838 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:45.176162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0993499-9392-40b5-9360-73e4de134b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:45.176662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0993499-9392-40b5-9360-73e4de134b60 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:45.176940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0993499-9392-40b5-9360-73e4de134b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:45.177207 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0993499-9392-40b5-9360-73e4de134b60 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:45.177911 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0993499-9392-40b5-9360-73e4de134b60 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:45.178279 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0993499-9392-40b5-9360-73e4de134b60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:45.179659 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0993499-9392-40b5-9360-73e4de134b60 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:45.185562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ae692-55ce-4912-8549-1f43ac064ddd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:45.187534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 258/507] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:45 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:45.188330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0993499-9392-40b5-9360-73e4de134b60 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:45.222551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ff7f1-b729-4855-8bfc-6f2a8b133659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:45.223158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ff7f1-b729-4855-8bfc-6f2a8b133659 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:45.223436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ff7f1-b729-4855-8bfc-6f2a8b133659 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:45.223730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ff7f1-b729-4855-8bfc-6f2a8b133659 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:45.224449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ff7f1-b729-4855-8bfc-6f2a8b133659 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:45.224789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ff7f1-b729-4855-8bfc-6f2a8b133659 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:45.227772 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ff7f1-b729-4855-8bfc-6f2a8b133659 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:45.245339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 250/508] 10.222.0.107 () {56 vars in 1142 bytes} [Tue Aug 23 23:11:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:45.246157 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ff7f1-b729-4855-8bfc-6f2a8b133659 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:45.289556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:45.294725 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0993499-9392-40b5-9360-73e4de134b60 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:45.330394 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3187f8f-809f-43b2-9b7b-cc1f772e03f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:45.331022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3187f8f-809f-43b2-9b7b-cc1f772e03f6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:45.331298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3187f8f-809f-43b2-9b7b-cc1f772e03f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:45.331570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3187f8f-809f-43b2-9b7b-cc1f772e03f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:45.342501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3187f8f-809f-43b2-9b7b-cc1f772e03f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:45.343957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3187f8f-809f-43b2-9b7b-cc1f772e03f6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:45.349508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ff7f1-b729-4855-8bfc-6f2a8b133659 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:45.358901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a3187f8f-809f-43b2-9b7b-cc1f772e03f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:45.358901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:45.358901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:45.358901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:45.358901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:45.358901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:45.358901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:45.358901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:45.358901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:45.358901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:45.358901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:45.358901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:45.358901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:45.358901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:45.358901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:45.358901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:45.359905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:45.359905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:45.359905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:45.359905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:45.359905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:45.359905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:45.359905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:45.359905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:45.359905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:45.359905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:45.359905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:45.359905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:45.359905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:45.359905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:45.359905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:45.359905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:45.359905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:45.360800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:45.360800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:45.360800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:45.360800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 259/509] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:45.361014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3187f8f-809f-43b2-9b7b-cc1f772e03f6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:45.387923 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b9249-b267-4a46-8e07-183c9e4accaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:45.388549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b9249-b267-4a46-8e07-183c9e4accaf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:45.388852 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b9249-b267-4a46-8e07-183c9e4accaf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:45.389125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b9249-b267-4a46-8e07-183c9e4accaf None admin] PATH_INFO: `/v3/users/glance` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:45.396543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b9249-b267-4a46-8e07-183c9e4accaf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:45.398437 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b9249-b267-4a46-8e07-183c9e4accaf None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:45.402999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:45.410153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-7a7b9249-b267-4a46-8e07-183c9e4accaf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:11:45.410153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:45.410153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:45.410153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:45.410153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:45.410153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:45.410153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:45.410153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:45.410153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:45.410153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:45.410153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:45.410153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:45.410153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:11:45.410153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:11:45.410153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:11:45.410153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:11:45.411281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:45.411281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:45.411281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:11:45.411281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:45.411281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:11:45.411281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:45.411281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:45.411281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:45.411281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:45.411281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:45.411281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:45.411281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:45.411281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:45.411281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:45.411281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:45.411281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:45.411281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:45.411281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:45.418039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:45.418039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:45.418039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:11:45.418039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:11:45.418039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:11:45.418039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:11:45.418039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:11:45.418039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:11:45.418039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:11:45.418039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:45.418039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 251/510] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:45.418039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b9249-b267-4a46-8e07-183c9e4accaf None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:45.471732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3187f8f-809f-43b2-9b7b-cc1f772e03f6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:45.506059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d9b09-f789-48e8-a46c-daed97db03f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:45.507202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d9b09-f789-48e8-a46c-daed97db03f0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:45.507474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d9b09-f789-48e8-a46c-daed97db03f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:45.507747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d9b09-f789-48e8-a46c-daed97db03f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:45.525782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:45.529106 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b9249-b267-4a46-8e07-183c9e4accaf None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:45.564323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a53e3-ee7e-454b-b0d4-bd5a6a522fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:45.564968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a53e3-ee7e-454b-b0d4-bd5a6a522fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:45.565248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a53e3-ee7e-454b-b0d4-bd5a6a522fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:45.565513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a53e3-ee7e-454b-b0d4-bd5a6a522fd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:45.576523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a53e3-ee7e-454b-b0d4-bd5a6a522fd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:45.578010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a53e3-ee7e-454b-b0d4-bd5a6a522fd2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:45.581080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d9b09-f789-48e8-a46c-daed97db03f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:45.582543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d9b09-f789-48e8-a46c-daed97db03f0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:45.592890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-997a53e3-ee7e-454b-b0d4-bd5a6a522fd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:45.592890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:45.592890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:45.592890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:45.592890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:45.592890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:45.592890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:45.592890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:45.592890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:45.592890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:45.592890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:45.592890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:45.592890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:45.592890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:45.592890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:45.592890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:45.594002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:45.594002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:45.594002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:45.594002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:45.594002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:45.594002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:45.594002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:45.594002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:45.594002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:45.594002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:45.594002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:45.594002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:45.594002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:45.594002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:45.594002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:45.594002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:45.594002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:45.594877 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:45.594877 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:45.594877 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:45.594877 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 252/511] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:45.595096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a53e3-ee7e-454b-b0d4-bd5a6a522fd2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:45.627352 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:45.687073 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 260/512] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:45 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:45.688003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d9b09-f789-48e8-a46c-daed97db03f0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:45.698787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a53e3-ee7e-454b-b0d4-bd5a6a522fd2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:45.733744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d4de7-9f06-4fe5-b8c4-ff315fac641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:45.734348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d4de7-9f06-4fe5-b8c4-ff315fac641a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:45.734621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d4de7-9f06-4fe5-b8c4-ff315fac641a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:45.734889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d4de7-9f06-4fe5-b8c4-ff315fac641a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:45.759162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:45.787344 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d9b09-f789-48e8-a46c-daed97db03f0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:45.807801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d4de7-9f06-4fe5-b8c4-ff315fac641a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:45.809293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d4de7-9f06-4fe5-b8c4-ff315fac641a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:45.825772 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cae7c-83d7-4445-961a-4c1de29e22be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:45.826555 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cae7c-83d7-4445-961a-4c1de29e22be None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:45.826837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cae7c-83d7-4445-961a-4c1de29e22be None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:45.827107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cae7c-83d7-4445-961a-4c1de29e22be None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:45.827754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cae7c-83d7-4445-961a-4c1de29e22be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:45.828057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cae7c-83d7-4445-961a-4c1de29e22be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:45.829455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cae7c-83d7-4445-961a-4c1de29e22be None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:45.838393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:45.842792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 261/513] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:45.843920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cae7c-83d7-4445-961a-4c1de29e22be None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:45.911342 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 253/514] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:45 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:45.912192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d4de7-9f06-4fe5-b8c4-ff315fac641a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:45.952640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cae7c-83d7-4445-961a-4c1de29e22be None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:45.965425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:45.986058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c1b83-4f72-4275-9cbe-00c1d342d3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:45.986750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c1b83-4f72-4275-9cbe-00c1d342d3e0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:45.987028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c1b83-4f72-4275-9cbe-00c1d342d3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:45.987289 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c1b83-4f72-4275-9cbe-00c1d342d3e0 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:45.988022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c1b83-4f72-4275-9cbe-00c1d342d3e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:45.988320 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c1b83-4f72-4275-9cbe-00c1d342d3e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:45.989771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c1b83-4f72-4275-9cbe-00c1d342d3e0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:46.017731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d4de7-9f06-4fe5-b8c4-ff315fac641a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:46.027780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 262/515] 10.222.0.107 () {56 vars in 1142 bytes} [Tue Aug 23 23:11:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:46.028645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c1b83-4f72-4275-9cbe-00c1d342d3e0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:46.052879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b6007-d99a-4ca0-b5fa-d75a85ff9c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:46.054060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b6007-d99a-4ca0-b5fa-d75a85ff9c5a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:46.054337 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b6007-d99a-4ca0-b5fa-d75a85ff9c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:46.054704 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b6007-d99a-4ca0-b5fa-d75a85ff9c5a None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:46.055350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b6007-d99a-4ca0-b5fa-d75a85ff9c5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:46.055651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b6007-d99a-4ca0-b5fa-d75a85ff9c5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:46.057058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b6007-d99a-4ca0-b5fa-d75a85ff9c5a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:46.070663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 254/516] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:46.071485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b6007-d99a-4ca0-b5fa-d75a85ff9c5a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:46.090520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:46.137060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c1b83-4f72-4275-9cbe-00c1d342d3e0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:46.172124 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4db519-e7b0-46a5-8254-18ff27e237e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:46.172788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4db519-e7b0-46a5-8254-18ff27e237e8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:46.173067 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4db519-e7b0-46a5-8254-18ff27e237e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:46.173334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4db519-e7b0-46a5-8254-18ff27e237e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:46.183173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b6007-d99a-4ca0-b5fa-d75a85ff9c5a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:46.183616 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4db519-e7b0-46a5-8254-18ff27e237e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:46.185119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4db519-e7b0-46a5-8254-18ff27e237e8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:46.196513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:46.200125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ba4db519-e7b0-46a5-8254-18ff27e237e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:46.200125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:46.200125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:46.200125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:46.200125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:46.200125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:46.200125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:46.200125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:46.200125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:46.200125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:46.200125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:46.200125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:46.200125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:46.200125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:46.200125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:46.200125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:46.201223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:46.201223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:46.201223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:46.201223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:46.201223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:46.201223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:46.201223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:46.201223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:46.201223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:46.201223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:46.201223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:46.201223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:46.201223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:46.201223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:46.201223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:46.201223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:46.201223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:46.202068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:46.202068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:46.202068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:46.202068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 263/517] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:46.202068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4db519-e7b0-46a5-8254-18ff27e237e8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:46.220749 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0600169-a238-4964-b03a-1c35f126647f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:46.221343 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0600169-a238-4964-b03a-1c35f126647f None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:46.221615 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0600169-a238-4964-b03a-1c35f126647f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:46.221877 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0600169-a238-4964-b03a-1c35f126647f None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:46.222498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0600169-a238-4964-b03a-1c35f126647f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:46.223935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0600169-a238-4964-b03a-1c35f126647f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:46.245428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 255/518] 10.222.0.107 () {60 vars in 1137 bytes} [Tue Aug 23 23:11:46 2022] POST /identity/v3/users => generated 248 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:11:46.246487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0600169-a238-4964-b03a-1c35f126647f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:46.316835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4db519-e7b0-46a5-8254-18ff27e237e8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:46.328668 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:46.355215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222858c-f111-43f2-8342-2a31fc2d42c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:46.355976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222858c-f111-43f2-8342-2a31fc2d42c2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:46.356324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222858c-f111-43f2-8342-2a31fc2d42c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:46.356801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222858c-f111-43f2-8342-2a31fc2d42c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:46.369489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222858c-f111-43f2-8342-2a31fc2d42c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:46.371109 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222858c-f111-43f2-8342-2a31fc2d42c2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:46.377471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0600169-a238-4964-b03a-1c35f126647f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:46.386647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-e222858c-f111-43f2-8342-2a31fc2d42c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:46.386647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:46.386647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:46.386647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:46.386647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:46.386647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:46.386647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:46.386647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:46.386647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:46.386647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:46.386647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:46.386647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:46.386647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:46.386647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:46.386647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:46.386647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:46.387617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:46.387617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:46.387617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:46.387617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:46.387617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:46.387617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:46.387617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:46.387617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:46.387617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:46.387617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:46.387617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:46.387617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:46.387617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:46.387617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:46.387617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:46.387617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:46.387617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:46.388758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:46.388758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:46.388758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:46.388758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 264/519] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:46.388758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222858c-f111-43f2-8342-2a31fc2d42c2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:46.427127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e7b7f-1fd7-43e8-b188-d71e2379512d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:46.428443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e7b7f-1fd7-43e8-b188-d71e2379512d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:46.428888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e7b7f-1fd7-43e8-b188-d71e2379512d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:46.429311 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e7b7f-1fd7-43e8-b188-d71e2379512d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:46.469041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:46.502517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222858c-f111-43f2-8342-2a31fc2d42c2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:46.508446 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e7b7f-1fd7-43e8-b188-d71e2379512d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:46.509956 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e7b7f-1fd7-43e8-b188-d71e2379512d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:46.541016 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7550a2-d466-4bc2-b72f-c6bceb72f452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:46.541651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7550a2-d466-4bc2-b72f-c6bceb72f452 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:46.541923 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7550a2-d466-4bc2-b72f-c6bceb72f452 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:46.542193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7550a2-d466-4bc2-b72f-c6bceb72f452 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:46.550299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7550a2-d466-4bc2-b72f-c6bceb72f452 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:46.551771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7550a2-d466-4bc2-b72f-c6bceb72f452 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:46.565202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-3e7550a2-d466-4bc2-b72f-c6bceb72f452 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:11:46.565202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:46.565202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:46.565202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:46.565202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:46.565202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:46.565202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:46.565202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:46.565202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:46.565202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:46.565202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:46.565202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:46.565202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:11:46.565202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:11:46.565202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:11:46.565202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:11:46.566143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:46.566143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:46.566143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:11:46.566143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:46.566143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:11:46.566143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:46.566143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:46.566143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:46.566143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:46.566143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:46.566143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:46.566143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:46.566143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:46.566143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:46.566143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:46.566143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:46.566143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:46.566143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:46.567079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:46.567079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:46.567079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:11:46.567079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:11:46.567079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:11:46.567079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:11:46.567079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:11:46.567079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:11:46.567079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:11:46.567079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:46.567079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 265/520] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:11:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:46.567646 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7550a2-d466-4bc2-b72f-c6bceb72f452 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:46.594230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:46.625274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 256/521] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:46 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:46.626236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e7b7f-1fd7-43e8-b188-d71e2379512d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:46.682535 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7550a2-d466-4bc2-b72f-c6bceb72f452 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:46.697589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:46.721512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c29b52-a21b-4c58-af61-0aed56f48eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:46.722652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c29b52-a21b-4c58-af61-0aed56f48eca None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:46.722942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c29b52-a21b-4c58-af61-0aed56f48eca None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:46.723215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c29b52-a21b-4c58-af61-0aed56f48eca None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:46.724145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c29b52-a21b-4c58-af61-0aed56f48eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:46.724449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c29b52-a21b-4c58-af61-0aed56f48eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:46.726644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c29b52-a21b-4c58-af61-0aed56f48eca None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:46.734751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e7b7f-1fd7-43e8-b188-d71e2379512d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:46.744032 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 266/522] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:46.744697 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c29b52-a21b-4c58-af61-0aed56f48eca None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:46.777118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5f5d6-9658-4e88-8981-abcf21772612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:46.777828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5f5d6-9658-4e88-8981-abcf21772612 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:46.778054 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5f5d6-9658-4e88-8981-abcf21772612 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:46.778319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5f5d6-9658-4e88-8981-abcf21772612 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:46.778949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5f5d6-9658-4e88-8981-abcf21772612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:46.779309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5f5d6-9658-4e88-8981-abcf21772612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:46.781343 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5f5d6-9658-4e88-8981-abcf21772612 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:46.802429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 257/523] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:46.802429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5f5d6-9658-4e88-8981-abcf21772612 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:46.841483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:46.863678 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c29b52-a21b-4c58-af61-0aed56f48eca None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:46.900499 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304f1ff-308b-4db4-a7db-c28109671fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:46.901135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304f1ff-308b-4db4-a7db-c28109671fad None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:46.901417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304f1ff-308b-4db4-a7db-c28109671fad None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:46.901684 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304f1ff-308b-4db4-a7db-c28109671fad None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:46.902418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304f1ff-308b-4db4-a7db-c28109671fad None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:46.902723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304f1ff-308b-4db4-a7db-c28109671fad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:46.904183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304f1ff-308b-4db4-a7db-c28109671fad None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:46.913249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5f5d6-9658-4e88-8981-abcf21772612 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:46.922903 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 267/524] 10.222.0.107 () {56 vars in 1144 bytes} [Tue Aug 23 23:11:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:46.923742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304f1ff-308b-4db4-a7db-c28109671fad None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:46.953570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:46.962862 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a9602-9c82-41bc-bac7-01715a69148c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:46.963489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a9602-9c82-41bc-bac7-01715a69148c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:46.963767 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a9602-9c82-41bc-bac7-01715a69148c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:46.964039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a9602-9c82-41bc-bac7-01715a69148c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:46.976392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a9602-9c82-41bc-bac7-01715a69148c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:46.977860 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a9602-9c82-41bc-bac7-01715a69148c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:46.993623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-318a9602-9c82-41bc-bac7-01715a69148c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:46.993623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:46.993623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:46.993623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:46.993623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:46.993623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:46.993623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:46.993623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:46.993623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:46.993623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:46.993623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:46.993623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:46.993623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:46.993623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:46.993623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:46.993623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:46.994673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:46.994673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:46.994673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:46.994673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:46.994673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:46.994673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:46.994673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:46.994673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:46.994673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:46.994673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:46.994673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:46.994673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:46.994673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:46.994673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:46.994673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:46.994673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:46.994673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:46.995540 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:46.995540 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:46.995540 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:46.999338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 258/525] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:47.000233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a9602-9c82-41bc-bac7-01715a69148c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:47.047672 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304f1ff-308b-4db4-a7db-c28109671fad None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:47.090150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df899d-2da5-4681-83ca-c7e972da9a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:47.091030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df899d-2da5-4681-83ca-c7e972da9a60 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:47.091455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df899d-2da5-4681-83ca-c7e972da9a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:47.091955 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df899d-2da5-4681-83ca-c7e972da9a60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:47.099331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df899d-2da5-4681-83ca-c7e972da9a60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:47.101515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df899d-2da5-4681-83ca-c7e972da9a60 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:47.104503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:47.112683 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a9602-9c82-41bc-bac7-01715a69148c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:47.116953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-58df899d-2da5-4681-83ca-c7e972da9a60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:47.116953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:47.116953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:47.116953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:47.116953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:47.116953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:47.116953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:47.116953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:47.116953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:47.116953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:47.116953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:47.116953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:47.116953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:11:47.116953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:11:47.116953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:11:47.117941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:11:47.117941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:47.117941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:47.117941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:47.117941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:47.117941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:47.117941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:47.117941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:47.117941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:47.117941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:47.117941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:47.117941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:47.117941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:47.117941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:47.117941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:47.117941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:47.117941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:47.119014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:11:47.119014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:11:47.119014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:11:47.119014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:11:47.119014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:11:47.119014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:11:47.119014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:47.119014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:47.120850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 268/526] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:47.121765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df899d-2da5-4681-83ca-c7e972da9a60 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:47.159196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadd559-7b5d-4928-ad23-1b28130147ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:47.160213 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadd559-7b5d-4928-ad23-1b28130147ae None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:47.160810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadd559-7b5d-4928-ad23-1b28130147ae None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:47.161230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadd559-7b5d-4928-ad23-1b28130147ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:47.168906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadd559-7b5d-4928-ad23-1b28130147ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:47.170786 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadd559-7b5d-4928-ad23-1b28130147ae None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:47.184406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-ddadd559-7b5d-4928-ad23-1b28130147ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:47.184406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:47.184406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:47.184406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:47.184406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:47.184406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:47.184406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:47.184406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:47.184406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:47.184406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:47.184406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:47.184406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:47.184406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:11:47.184406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:11:47.184406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:11:47.185474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:11:47.185474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:47.185474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:47.185474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:47.185474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:47.185474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:47.185474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:47.185474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:47.185474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:47.185474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:47.185474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:47.185474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:47.185474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:47.185474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:47.185474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:47.185474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:47.185474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:47.186332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:11:47.186332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:11:47.186332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:11:47.186332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:11:47.186332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:11:47.186332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:11:47.186332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:47.186332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:47.188063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 259/527] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:47.189117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadd559-7b5d-4928-ad23-1b28130147ae None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:47.239873 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df899d-2da5-4681-83ca-c7e972da9a60 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:47.240070 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:47.287247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699a366-bc7d-452a-af15-a2a5f83bc096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:47.288192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699a366-bc7d-452a-af15-a2a5f83bc096 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:47.288525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699a366-bc7d-452a-af15-a2a5f83bc096 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:47.289054 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699a366-bc7d-452a-af15-a2a5f83bc096 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:47.308525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadd559-7b5d-4928-ad23-1b28130147ae None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:47.344394 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dfbc4-0ac5-477e-b885-6f3b579f74cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:47.345342 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dfbc4-0ac5-477e-b885-6f3b579f74cb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:47.345815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dfbc4-0ac5-477e-b885-6f3b579f74cb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:47.346265 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dfbc4-0ac5-477e-b885-6f3b579f74cb None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:47.347075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52dfbc4-0ac5-477e-b885-6f3b579f74cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:47.347576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52dfbc4-0ac5-477e-b885-6f3b579f74cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:47.349143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52dfbc4-0ac5-477e-b885-6f3b579f74cb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:47.362000 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 260/528] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:47.363078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dfbc4-0ac5-477e-b885-6f3b579f74cb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:47.366376 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699a366-bc7d-452a-af15-a2a5f83bc096 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:47.368659 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699a366-bc7d-452a-af15-a2a5f83bc096 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:47.371241 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:47.489959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:47.493749 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dfbc4-0ac5-477e-b885-6f3b579f74cb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:47.495744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 269/529] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:47 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:47.497391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699a366-bc7d-452a-af15-a2a5f83bc096 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:47.535859 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6396a7b-e1a3-43d0-b43c-6120aac74165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:47.536475 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6396a7b-e1a3-43d0-b43c-6120aac74165 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:47.536786 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6396a7b-e1a3-43d0-b43c-6120aac74165 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:47.537062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6396a7b-e1a3-43d0-b43c-6120aac74165 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:47.538472 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6396a7b-e1a3-43d0-b43c-6120aac74165 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:47.538833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6396a7b-e1a3-43d0-b43c-6120aac74165 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:47.540807 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6396a7b-e1a3-43d0-b43c-6120aac74165 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:47.569595 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 261/530] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:11:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:47.570383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6396a7b-e1a3-43d0-b43c-6120aac74165 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:47.610797 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:47.614377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699a366-bc7d-452a-af15-a2a5f83bc096 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:47.654274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a246e81-3f6a-4caf-a364-385d1657dd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:47.655296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246e81-3f6a-4caf-a364-385d1657dd77 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:47.655598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246e81-3f6a-4caf-a364-385d1657dd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:47.655872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246e81-3f6a-4caf-a364-385d1657dd77 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:47.656573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a246e81-3f6a-4caf-a364-385d1657dd77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:47.657264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a246e81-3f6a-4caf-a364-385d1657dd77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:47.659094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a246e81-3f6a-4caf-a364-385d1657dd77 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:47.679693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 270/531] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:11:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:47.680513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a246e81-3f6a-4caf-a364-385d1657dd77 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:47.687272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6396a7b-e1a3-43d0-b43c-6120aac74165 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:47.725880 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29f351-d122-4076-b0ef-36ab4a376ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:47.727002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29f351-d122-4076-b0ef-36ab4a376ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:47.727420 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29f351-d122-4076-b0ef-36ab4a376ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:47.727704 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29f351-d122-4076-b0ef-36ab4a376ae9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:47.735055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29f351-d122-4076-b0ef-36ab4a376ae9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:47.736504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29f351-d122-4076-b0ef-36ab4a376ae9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:47.748583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-ed29f351-d122-4076-b0ef-36ab4a376ae9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:47.748583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:47.748583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:47.748583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:47.748583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:47.748583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:47.748583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:47.748583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:47.748583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:47.748583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:47.748583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:47.748583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:47.748583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:11:47.748583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:11:47.748583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:11:47.749459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:11:47.749459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:47.749459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:47.749459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:47.749459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:47.749459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:47.749459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:47.749459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:47.749459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:47.749459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:47.749459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:47.749459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:47.749459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:47.749459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:47.749459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:47.749459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:47.749459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:47.751069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:11:47.751069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:11:47.751069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:11:47.751069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:11:47.751069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:11:47.751069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:11:47.751069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:47.751069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:47.751069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 262/532] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:47.751069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29f351-d122-4076-b0ef-36ab4a376ae9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:47.779746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:47.792719 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a246e81-3f6a-4caf-a364-385d1657dd77 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:47.832419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937b024-a59c-4417-9c80-756a78b6d3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:47.832876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937b024-a59c-4417-9c80-756a78b6d3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:47.833149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937b024-a59c-4417-9c80-756a78b6d3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:47.833414 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937b024-a59c-4417-9c80-756a78b6d3c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:47.846367 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937b024-a59c-4417-9c80-756a78b6d3c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:47.847841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937b024-a59c-4417-9c80-756a78b6d3c5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:47.866086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-0937b024-a59c-4417-9c80-756a78b6d3c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:47.866086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:47.866086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:47.866086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:47.866086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:47.866086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:47.866086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:47.866086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:47.866086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:47.866086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:47.866086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:47.866086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:47.866086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:47.866086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:47.866086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:47.866086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:47.867347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:47.867347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:47.867347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:47.867347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:47.867347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:47.867347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:47.867347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:47.867347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:47.867347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:47.867347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:47.867347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:47.867347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:47.867347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:47.867347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:47.867347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:47.867347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:47.867347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:47.868355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:47.868355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:47.868355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:47.868355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 271/533] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:47.868579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937b024-a59c-4417-9c80-756a78b6d3c5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:47.889236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:47.903494 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29f351-d122-4076-b0ef-36ab4a376ae9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:47.944996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3428ed-7f37-4efc-920b-8cd5157c6004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:47.945873 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3428ed-7f37-4efc-920b-8cd5157c6004 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:47.946143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3428ed-7f37-4efc-920b-8cd5157c6004 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:47.946417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3428ed-7f37-4efc-920b-8cd5157c6004 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:47.947152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3428ed-7f37-4efc-920b-8cd5157c6004 None admin] RBAC: Adding query filter params (role.id=ee7f9512e7e745199ff5ed847343d11a, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=2f985626d8af4f3089e72998fad98b47) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:47.947452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3428ed-7f37-4efc-920b-8cd5157c6004 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:47.948926 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3428ed-7f37-4efc-920b-8cd5157c6004 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:47.955434 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 263/534] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:11:47 2022] GET /identity/v3/role_assignments?user.id=2f985626d8af4f3089e72998fad98b47&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=ee7f9512e7e745199ff5ed847343d11a => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:47.956261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3428ed-7f37-4efc-920b-8cd5157c6004 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:48.017393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937b024-a59c-4417-9c80-756a78b6d3c5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:48.073092 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89de8e8-7455-4341-b39e-dd8442b51fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:48.073765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89de8e8-7455-4341-b39e-dd8442b51fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:48.074040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89de8e8-7455-4341-b39e-dd8442b51fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:48.074351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89de8e8-7455-4341-b39e-dd8442b51fd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:48.075217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89de8e8-7455-4341-b39e-dd8442b51fd4 None admin] RBAC: Adding query filter params (role.id=ee7f9512e7e745199ff5ed847343d11a, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=8937ae9f5c7840a2a5af5f851d02ea77) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:48.075515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89de8e8-7455-4341-b39e-dd8442b51fd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:48.077133 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89de8e8-7455-4341-b39e-dd8442b51fd4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:48.080231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:48.093091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 272/535] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:11:47 2022] GET /identity/v3/role_assignments?user.id=8937ae9f5c7840a2a5af5f851d02ea77&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=ee7f9512e7e745199ff5ed847343d11a => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:48.094457 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89de8e8-7455-4341-b39e-dd8442b51fd4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:48.104068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3428ed-7f37-4efc-920b-8cd5157c6004 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:48.153908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9eff3-6948-498b-b19a-a79f7433cb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:48.154848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9eff3-6948-498b-b19a-a79f7433cb02 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:48.155339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9eff3-6948-498b-b19a-a79f7433cb02 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:48.156137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9eff3-6948-498b-b19a-a79f7433cb02 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:48.158294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9eff3-6948-498b-b19a-a79f7433cb02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:48.158870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9eff3-6948-498b-b19a-a79f7433cb02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:48.160578 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9eff3-6948-498b-b19a-a79f7433cb02 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:48.185086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 264/536] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:11:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:48.191278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9eff3-6948-498b-b19a-a79f7433cb02 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:48.255510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:48.296217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89de8e8-7455-4341-b39e-dd8442b51fd4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:48.332442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8ae53-2847-491d-b169-b8ae790672b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:48.333087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8ae53-2847-491d-b169-b8ae790672b6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:48.333397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8ae53-2847-491d-b169-b8ae790672b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:48.334042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8ae53-2847-491d-b169-b8ae790672b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:48.334386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8ae53-2847-491d-b169-b8ae790672b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:48.335291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8ae53-2847-491d-b169-b8ae790672b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:48.336694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8ae53-2847-491d-b169-b8ae790672b6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:48.349494 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9eff3-6948-498b-b19a-a79f7433cb02 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:48.354650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 273/537] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:48.356084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2669f-602e-4fe9-a87d-d577d9b35e33 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:48.356370 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2669f-602e-4fe9-a87d-d577d9b35e33 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:48.356670 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2669f-602e-4fe9-a87d-d577d9b35e33 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:48.358250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 274/538] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:48.359226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2669f-602e-4fe9-a87d-d577d9b35e33 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:48.389049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5724e-61bc-4be0-b6dd-9b8877851d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:48.390158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5724e-61bc-4be0-b6dd-9b8877851d8a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:48.390719 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5724e-61bc-4be0-b6dd-9b8877851d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:48.391181 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5724e-61bc-4be0-b6dd-9b8877851d8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:48.392092 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5724e-61bc-4be0-b6dd-9b8877851d8a None admin] RBAC: Adding query filter params (role.id=ee7f9512e7e745199ff5ed847343d11a, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=a43ac193836248959a0380a76549ec10) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:48.392626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5724e-61bc-4be0-b6dd-9b8877851d8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:48.394467 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5724e-61bc-4be0-b6dd-9b8877851d8a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:48.401643 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 265/539] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:11:48 2022] GET /identity/v3/role_assignments?user.id=a43ac193836248959a0380a76549ec10&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=ee7f9512e7e745199ff5ed847343d11a => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:48.410618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd135a-05de-4dd6-889d-77f6ef895a5f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:48.411153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd135a-05de-4dd6-889d-77f6ef895a5f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:48.411615 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd135a-05de-4dd6-889d-77f6ef895a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:48.441935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-33fd135a-05de-4dd6-889d-77f6ef895a5f None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:48.443462 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-33fd135a-05de-4dd6-889d-77f6ef895a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:48.450710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:48.483436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2669f-602e-4fe9-a87d-d577d9b35e33 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:48.523280 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f05f2-fbbf-49b8-b644-d4213a4e0d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:48.524223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f05f2-fbbf-49b8-b644-d4213a4e0d2f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:48.524699 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f05f2-fbbf-49b8-b644-d4213a4e0d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:48.525114 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f05f2-fbbf-49b8-b644-d4213a4e0d2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:48.539634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:48.545077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f05f2-fbbf-49b8-b644-d4213a4e0d2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:48.546650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f05f2-fbbf-49b8-b644-d4213a4e0d2f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:48.566260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ef2f05f2-fbbf-49b8-b644-d4213a4e0d2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:48.566260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:48.566260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:48.566260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:48.566260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:48.566260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:48.566260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:48.566260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:48.566260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:48.566260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:48.566260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:48.566260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:48.566260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:11:48.566260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:11:48.566260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:11:48.567161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:11:48.567161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:48.567161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:48.567161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:48.567161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:48.567161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:48.567161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:48.567161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:48.567161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:48.567161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:48.567161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:48.567161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:48.567161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:48.567161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:48.567161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:48.567161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:48.567161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:48.568015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:11:48.568015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:11:48.568015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:11:48.568015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:11:48.568015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:11:48.568015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:11:48.568015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:48.568015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:48.574573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 275/540] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:48.579721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f05f2-fbbf-49b8-b644-d4213a4e0d2f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:48.609784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 266/541] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:48.738843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f05f2-fbbf-49b8-b644-d4213a4e0d2f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:48.779670 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9304945-d47b-48b1-a2a5-794d501d8aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:48.780299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9304945-d47b-48b1-a2a5-794d501d8aee None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:48.780578 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9304945-d47b-48b1-a2a5-794d501d8aee None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:48.780877 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9304945-d47b-48b1-a2a5-794d501d8aee None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:48.781584 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9304945-d47b-48b1-a2a5-794d501d8aee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:48.781888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9304945-d47b-48b1-a2a5-794d501d8aee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:48.783416 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9304945-d47b-48b1-a2a5-794d501d8aee None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:48.798225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 276/542] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:48.805018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd135a-05de-4dd6-889d-77f6ef895a5f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:48.932624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd135a-05de-4dd6-889d-77f6ef895a5f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:48.985147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3188c3d-7692-4659-a7a2-ca393fa1229a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:48.985828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3188c3d-7692-4659-a7a2-ca393fa1229a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:48.986115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3188c3d-7692-4659-a7a2-ca393fa1229a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:48.986390 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3188c3d-7692-4659-a7a2-ca393fa1229a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:48.987127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3188c3d-7692-4659-a7a2-ca393fa1229a None admin] RBAC: Adding query filter params (role.id=ee7f9512e7e745199ff5ed847343d11a, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=b88d0d18ad66438191541b84fc1431bf) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:48.987435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3188c3d-7692-4659-a7a2-ca393fa1229a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:48.988942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3188c3d-7692-4659-a7a2-ca393fa1229a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:49.001099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 267/543] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:11:48 2022] GET /identity/v3/role_assignments?user.id=b88d0d18ad66438191541b84fc1431bf&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=ee7f9512e7e745199ff5ed847343d11a => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:49.008860 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9304945-d47b-48b1-a2a5-794d501d8aee None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:49.082702 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:49.133203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9304945-d47b-48b1-a2a5-794d501d8aee None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:49.187079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2ad22-0156-4e40-af6d-a6ddbd1187d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:49.187730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2ad22-0156-4e40-af6d-a6ddbd1187d0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:49.188004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2ad22-0156-4e40-af6d-a6ddbd1187d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:49.188271 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2ad22-0156-4e40-af6d-a6ddbd1187d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:49.209253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2ad22-0156-4e40-af6d-a6ddbd1187d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:49.215170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f7a2ad22-0156-4e40-af6d-a6ddbd1187d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:49.215170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:49.215170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:49.215170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:49.215170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:49.215170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:49.215170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:49.215170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:49.215170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:49.215170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:49.215170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:49.215170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:49.215170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:49.215170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:49.215170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:49.215170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:49.216172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:49.216172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:49.216172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:49.216172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:49.216172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:49.216172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:49.216172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:49.216172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:49.216172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:49.216172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:49.216172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:49.216172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:49.216172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:49.216172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:49.216172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:49.216172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:49.216997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:49.216997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:49.216997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:49.216997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:49.216997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:49.216997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:49.216997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:49.216997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:49.216997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:49.216997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:49.216997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:49.216997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:49.220707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 277/544] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:11:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:49.223606 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3188c3d-7692-4659-a7a2-ca393fa1229a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:49.227520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:49.338243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3188c3d-7692-4659-a7a2-ca393fa1229a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:49.391687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d56f52-2805-4778-aa16-db74aa62a9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:49.392296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d56f52-2805-4778-aa16-db74aa62a9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:49.392576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d56f52-2805-4778-aa16-db74aa62a9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:49.392870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d56f52-2805-4778-aa16-db74aa62a9d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:49.393539 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d56f52-2805-4778-aa16-db74aa62a9d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:49.393838 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d56f52-2805-4778-aa16-db74aa62a9d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:49.395197 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d56f52-2805-4778-aa16-db74aa62a9d5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:49.407958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 268/545] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:49 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:49.414035 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2ad22-0156-4e40-af6d-a6ddbd1187d0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:49.544817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2ad22-0156-4e40-af6d-a6ddbd1187d0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:49.566361 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:49.598242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a215d0a-8f92-4b0f-8f18-217b4587642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:49.599248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a215d0a-8f92-4b0f-8f18-217b4587642f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:49.599760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a215d0a-8f92-4b0f-8f18-217b4587642f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:49.600855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a215d0a-8f92-4b0f-8f18-217b4587642f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:49.621962 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a215d0a-8f92-4b0f-8f18-217b4587642f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:49.624808 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a215d0a-8f92-4b0f-8f18-217b4587642f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:49.648910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-9a215d0a-8f92-4b0f-8f18-217b4587642f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:49.648910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:49.648910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:49.648910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:49.648910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:49.648910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:49.648910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:49.648910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:49.648910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:49.648910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:49.648910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:49.648910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:49.648910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:49.648910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:49.648910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:49.648910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:49.649857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:49.649857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:49.649857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:49.649857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:49.649857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:49.649857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:49.649857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:49.649857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:49.649857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:49.649857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:49.649857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:49.649857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:49.649857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:49.649857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:49.649857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:49.649857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:49.649857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:49.650686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:49.650686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:49.650686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:49.650686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 278/546] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:49.656896 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d56f52-2805-4778-aa16-db74aa62a9d5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:49.761778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:49.814279 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d56f52-2805-4778-aa16-db74aa62a9d5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:49.852718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ed92e-993a-4a38-b1e6-4960c50160a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:49.853302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ed92e-993a-4a38-b1e6-4960c50160a9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:49.853573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ed92e-993a-4a38-b1e6-4960c50160a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:49.853851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ed92e-993a-4a38-b1e6-4960c50160a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:49.854608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ed92e-993a-4a38-b1e6-4960c50160a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:49.854905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ed92e-993a-4a38-b1e6-4960c50160a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:49.856280 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ed92e-993a-4a38-b1e6-4960c50160a9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:49.876521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 269/547] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:49.883419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a215d0a-8f92-4b0f-8f18-217b4587642f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:50.024074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a215d0a-8f92-4b0f-8f18-217b4587642f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:50.063703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba329d-6761-4a03-b5b6-a5a4b6c6f9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:50.064354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba329d-6761-4a03-b5b6-a5a4b6c6f9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:50.064648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba329d-6761-4a03-b5b6-a5a4b6c6f9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:50.064920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba329d-6761-4a03-b5b6-a5a4b6c6f9e4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:50.077128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba329d-6761-4a03-b5b6-a5a4b6c6f9e4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:50.078719 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba329d-6761-4a03-b5b6-a5a4b6c6f9e4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:50.092551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-82ba329d-6761-4a03-b5b6-a5a4b6c6f9e4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:11:50.092551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:50.092551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:50.092551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:50.092551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:50.092551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:50.092551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:50.092551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:50.092551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:50.092551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:50.092551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:50.092551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:50.092551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:11:50.092551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:11:50.092551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:11:50.092551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:11:50.093498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:50.093498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:50.093498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:11:50.093498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:50.093498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:11:50.093498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:50.093498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:50.093498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:50.093498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:50.093498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:50.093498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:50.093498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:50.093498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:50.093498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:50.093498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:50.093498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:50.093498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:50.093498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:50.094964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:50.094964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:50.094964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:11:50.094964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:11:50.094964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:11:50.094964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:11:50.094964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:11:50.094964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:11:50.094964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:11:50.094964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:50.094964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 279/548] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:11:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:50.101326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ed92e-993a-4a38-b1e6-4960c50160a9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:50.250476 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ed92e-993a-4a38-b1e6-4960c50160a9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:50.289892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:50.303065 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17627f5e-77e6-4c14-b10b-2213c69a0bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:50.304438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17627f5e-77e6-4c14-b10b-2213c69a0bac None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:50.304956 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17627f5e-77e6-4c14-b10b-2213c69a0bac None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:50.305244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17627f5e-77e6-4c14-b10b-2213c69a0bac None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:50.305980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17627f5e-77e6-4c14-b10b-2213c69a0bac None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:50.306282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17627f5e-77e6-4c14-b10b-2213c69a0bac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:50.307726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17627f5e-77e6-4c14-b10b-2213c69a0bac None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:50.334946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 270/549] 10.222.0.107 () {56 vars in 1140 bytes} [Tue Aug 23 23:11:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:50.340853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba329d-6761-4a03-b5b6-a5a4b6c6f9e4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:50.395601 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:50.454934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cfba0-189e-4813-b874-029207a9fc49 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:50.455212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cfba0-189e-4813-b874-029207a9fc49 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:50.455483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cfba0-189e-4813-b874-029207a9fc49 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:50.457890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 271/550] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:50.462926 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266defc-fa13-4fae-afce-7dc3b3559c0e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:50.463226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266defc-fa13-4fae-afce-7dc3b3559c0e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:50.463471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266defc-fa13-4fae-afce-7dc3b3559c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:50.490102 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba329d-6761-4a03-b5b6-a5a4b6c6f9e4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:50.498957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4266defc-fa13-4fae-afce-7dc3b3559c0e None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:50.500176 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4266defc-fa13-4fae-afce-7dc3b3559c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:50.540734 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fd519-735e-4787-ae0a-5f9c5fedce61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:50.541827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fd519-735e-4787-ae0a-5f9c5fedce61 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:50.542329 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fd519-735e-4787-ae0a-5f9c5fedce61 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:50.543055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fd519-735e-4787-ae0a-5f9c5fedce61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:50.615225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 272/551] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:50.618242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9fd87-92b3-4eaf-8fae-32ac55f3245f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:50.618937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9fd87-92b3-4eaf-8fae-32ac55f3245f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:50.619775 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9fd87-92b3-4eaf-8fae-32ac55f3245f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:50.621679 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 273/552] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:50 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:50.627989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8da21-6e27-41e8-b182-df8911def148 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:50.628263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8da21-6e27-41e8-b182-df8911def148 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:50.628545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8da21-6e27-41e8-b182-df8911def148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:50.645914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fd519-735e-4787-ae0a-5f9c5fedce61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:50.648698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fd519-735e-4787-ae0a-5f9c5fedce61 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:50.671879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0ad8da21-6e27-41e8-b182-df8911def148 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:50.673097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0ad8da21-6e27-41e8-b182-df8911def148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:50.720987 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:50.808015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 280/553] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:50 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:50.808933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 274/554] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:50.825524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fd519-735e-4787-ae0a-5f9c5fedce61 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:50.945715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8da21-6e27-41e8-b182-df8911def148 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:50.979339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fd519-735e-4787-ae0a-5f9c5fedce61 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:51.012991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:51.026582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:51.035793 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b188e-5ef0-4127-8c4e-0887985865c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:51.036802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b188e-5ef0-4127-8c4e-0887985865c8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.037254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b188e-5ef0-4127-8c4e-0887985865c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.037834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b188e-5ef0-4127-8c4e-0887985865c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.050189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b188e-5ef0-4127-8c4e-0887985865c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:51.051954 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b188e-5ef0-4127-8c4e-0887985865c8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:51.072332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ae2b188e-5ef0-4127-8c4e-0887985865c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:51.072332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:51.072332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:51.072332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:51.072332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:51.072332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:51.072332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:51.072332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:51.072332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:51.072332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:51.072332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:51.072332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:51.072332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:51.072332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:51.072332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:51.072332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:51.073332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:51.073332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:51.073332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:51.073332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:51.073332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:51.073332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:51.073332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:51.073332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:51.073332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:51.073332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:51.073332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:51.073332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:51.073332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:51.073332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:51.073332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:51.073332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:51.073332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:51.074179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:51.074179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:51.074179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:51.074378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8da21-6e27-41e8-b182-df8911def148 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:51.080544 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 281/555] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:51.082052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa4afd-37e1-40a1-a073-278e5c53ae4e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.082531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa4afd-37e1-40a1-a073-278e5c53ae4e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.082944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa4afd-37e1-40a1-a073-278e5c53ae4e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.085228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 282/556] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:51.086321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa4afd-37e1-40a1-a073-278e5c53ae4e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:51.110948 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cef60-61b7-405e-a237-75b9ed150ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:51.111984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cef60-61b7-405e-a237-75b9ed150ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.111984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cef60-61b7-405e-a237-75b9ed150ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.112419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cef60-61b7-405e-a237-75b9ed150ee8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.123888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03cef60-61b7-405e-a237-75b9ed150ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:51.129380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e03cef60-61b7-405e-a237-75b9ed150ee8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:51.129380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:51.129380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:51.129380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:51.129380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:51.129380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:51.129380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:51.129380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:51.129380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:51.129380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:51.129380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:51.129380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:51.129380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:51.129380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:51.129380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:51.129380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:51.130570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:51.130570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:51.130570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:51.130570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:51.130570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:51.130570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:51.130570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:51.130570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:51.130570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:51.130570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:51.130570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:51.130570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:51.130570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:51.130570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:51.130570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:51.130570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:51.132400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:51.132400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:51.132400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:51.132400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:51.132400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:51.132400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:51.132400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:51.132400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:51.132400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:51.132400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:51.132400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:51.132400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:51.132400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 275/557] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:11:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:51.138014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae04e7d-1722-4d41-9f04-6a0039db75c3 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.138370 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae04e7d-1722-4d41-9f04-6a0039db75c3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.138719 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae04e7d-1722-4d41-9f04-6a0039db75c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.159327 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-aae04e7d-1722-4d41-9f04-6a0039db75c3 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:51.161201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-aae04e7d-1722-4d41-9f04-6a0039db75c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:51.206496 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa4afd-37e1-40a1-a073-278e5c53ae4e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:51.235205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 276/558] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:51.240866 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae04e7d-1722-4d41-9f04-6a0039db75c3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:51.256749 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa38a94-8fb7-43c8-9cdb-2553fbd9a103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:51.257720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa38a94-8fb7-43c8-9cdb-2553fbd9a103 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.258074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa38a94-8fb7-43c8-9cdb-2553fbd9a103 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.258524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa38a94-8fb7-43c8-9cdb-2553fbd9a103 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.259236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa38a94-8fb7-43c8-9cdb-2553fbd9a103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:51.259604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa38a94-8fb7-43c8-9cdb-2553fbd9a103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:51.261275 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa38a94-8fb7-43c8-9cdb-2553fbd9a103 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:51.279392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 283/559] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:51.280497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa38a94-8fb7-43c8-9cdb-2553fbd9a103 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:51.281574 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:51.330900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:51.377112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae04e7d-1722-4d41-9f04-6a0039db75c3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:51.401161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa38a94-8fb7-43c8-9cdb-2553fbd9a103 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:51.425333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae644f6b-0790-4438-8360-11ef8cf10989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:51.425982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae644f6b-0790-4438-8360-11ef8cf10989 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.426255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae644f6b-0790-4438-8360-11ef8cf10989 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.426519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae644f6b-0790-4438-8360-11ef8cf10989 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.427182 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae644f6b-0790-4438-8360-11ef8cf10989 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:51.427703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae644f6b-0790-4438-8360-11ef8cf10989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:51.429850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae644f6b-0790-4438-8360-11ef8cf10989 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:51.442894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 277/560] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:51 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:51.442894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae644f6b-0790-4438-8360-11ef8cf10989 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:51.455027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a567c9-24e8-4f5b-b786-e3120c87d7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:51.455973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a567c9-24e8-4f5b-b786-e3120c87d7cf None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.456844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a567c9-24e8-4f5b-b786-e3120c87d7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.457262 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a567c9-24e8-4f5b-b786-e3120c87d7cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.471953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a567c9-24e8-4f5b-b786-e3120c87d7cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:51.479798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-97a567c9-24e8-4f5b-b786-e3120c87d7cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:51.479798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:51.479798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:51.479798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:51.479798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:51.479798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:51.479798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:51.479798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:51.479798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:51.479798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:51.479798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:51.479798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:51.479798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:51.479798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:51.479798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:51.479798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:51.480961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:51.480961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:51.480961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:51.480961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:51.480961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:51.480961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:51.480961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:51.480961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:51.480961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:51.480961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:51.480961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:51.480961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:51.480961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:51.480961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:51.480961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:51.480961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:51.481805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:51.481805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:51.481805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:51.481805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:51.481805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:51.481805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:51.481805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:51.481805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:51.481805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:51.481805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:51.481805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:51.481805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:51.484389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 284/561] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:11:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:51.485643 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a567c9-24e8-4f5b-b786-e3120c87d7cf None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:51.557309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:51.564368 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae644f6b-0790-4438-8360-11ef8cf10989 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:51.591687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:51.594969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a567c9-24e8-4f5b-b786-e3120c87d7cf None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:51.598633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5433e-38dc-431a-a5da-66ddb18a2122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:51.599266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5433e-38dc-431a-a5da-66ddb18a2122 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.599542 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5433e-38dc-431a-a5da-66ddb18a2122 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.599819 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5433e-38dc-431a-a5da-66ddb18a2122 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.607461 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5433e-38dc-431a-a5da-66ddb18a2122 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:51.608939 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5433e-38dc-431a-a5da-66ddb18a2122 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:51.621533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-28c5433e-38dc-431a-a5da-66ddb18a2122 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:51.621533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:51.621533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:51.621533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:51.621533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:51.621533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:51.621533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:51.621533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:51.621533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:51.621533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:51.621533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:51.621533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:51.621533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:11:51.621533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:11:51.621533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:11:51.622853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:11:51.622853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:51.622853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:51.622853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:51.622853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:51.622853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:51.622853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:51.622853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:51.622853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:51.622853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:51.622853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:51.622853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:51.622853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:51.622853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:51.622853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:51.622853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:51.622853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:51.623744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:11:51.623744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:11:51.623744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:11:51.623744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:11:51.623744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:11:51.623744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:11:51.623744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:51.623744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:51.623744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 278/562] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:51.624249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced4ba7-b2cd-45c3-8730-915528c6afa7 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.624490 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced4ba7-b2cd-45c3-8730-915528c6afa7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.624906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced4ba7-b2cd-45c3-8730-915528c6afa7 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.626609 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 279/563] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:51.627461 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced4ba7-b2cd-45c3-8730-915528c6afa7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:51.641549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3fd97-a68e-4828-a8bc-f000a7beda15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:51.642183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3fd97-a68e-4828-a8bc-f000a7beda15 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.642453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3fd97-a68e-4828-a8bc-f000a7beda15 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.642715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3fd97-a68e-4828-a8bc-f000a7beda15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.653896 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3fd97-a68e-4828-a8bc-f000a7beda15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:51.655428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3fd97-a68e-4828-a8bc-f000a7beda15 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:51.670724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-37e3fd97-a68e-4828-a8bc-f000a7beda15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:51.670724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:51.670724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:51.670724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:51.670724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:51.670724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:51.670724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:51.670724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:51.670724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:51.670724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:51.670724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:51.670724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:51.670724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:51.670724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:51.670724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:51.670724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:51.672033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:51.672033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:51.672033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:51.672033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:51.672033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:51.672033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:51.672033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:51.672033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:51.672033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:51.672033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:51.672033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:51.672033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:51.672033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:51.672033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:51.672033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:51.672033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:51.672033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:51.673170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:51.673170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:51.673170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:51.673734 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 285/564] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:51.674533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3fd97-a68e-4828-a8bc-f000a7beda15 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:51.739233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced4ba7-b2cd-45c3-8730-915528c6afa7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:51.773935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3fd97-a68e-4828-a8bc-f000a7beda15 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:51.774193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022d8bd-928c-4966-9c64-028c61fa73fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:51.774770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022d8bd-928c-4966-9c64-028c61fa73fe None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.775049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022d8bd-928c-4966-9c64-028c61fa73fe None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.775413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022d8bd-928c-4966-9c64-028c61fa73fe None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.776006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022d8bd-928c-4966-9c64-028c61fa73fe None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:51.776313 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022d8bd-928c-4966-9c64-028c61fa73fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:51.777737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022d8bd-928c-4966-9c64-028c61fa73fe None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:51.785731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 280/565] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:51 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:51.786655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022d8bd-928c-4966-9c64-028c61fa73fe None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:51.805271 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:51.812183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb0343-a967-4ea5-8069-61d0dbf0592b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:51.812850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb0343-a967-4ea5-8069-61d0dbf0592b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.813123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb0343-a967-4ea5-8069-61d0dbf0592b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.813390 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb0343-a967-4ea5-8069-61d0dbf0592b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.824175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb0343-a967-4ea5-8069-61d0dbf0592b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:51.829340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d4fb0343-a967-4ea5-8069-61d0dbf0592b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:51.829340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:51.829340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:51.829340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:51.829340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:51.829340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:51.829340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:51.829340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:51.829340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:51.829340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:51.829340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:51.829340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:51.829340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:51.829340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:51.829340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:51.829340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:51.835675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:51.835675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:51.835675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:51.835675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:51.835675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:51.835675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:51.835675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:51.835675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:51.835675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:51.835675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:51.835675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:51.835675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:51.835675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:51.835675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:51.835675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:51.835675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:51.836751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:51.836751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:51.836751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:51.836751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:51.836751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:51.836751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:51.836751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:51.836751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:51.836751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:51.836751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:51.836751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:51.836751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:51.836751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 286/566] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:11:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:51.836751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0535df9-34f7-4d01-8182-a5d5ddf293c9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.837527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0535df9-34f7-4d01-8182-a5d5ddf293c9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.837527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0535df9-34f7-4d01-8182-a5d5ddf293c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.849690 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e0535df9-34f7-4d01-8182-a5d5ddf293c9 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:51.850880 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e0535df9-34f7-4d01-8182-a5d5ddf293c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:51.858133 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:51.896424 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022d8bd-928c-4966-9c64-028c61fa73fe None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:51.925149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 287/567] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:51.926002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0535df9-34f7-4d01-8182-a5d5ddf293c9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:51.930638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa6065-f258-4a72-ba60-338043400fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:51.931242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa6065-f258-4a72-ba60-338043400fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:51.931522 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa6065-f258-4a72-ba60-338043400fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:51.931795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa6065-f258-4a72-ba60-338043400fc4 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:51.932489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa6065-f258-4a72-ba60-338043400fc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:51.932824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa6065-f258-4a72-ba60-338043400fc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:51.934254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa6065-f258-4a72-ba60-338043400fc4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:51.947099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 281/568] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:11:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:51.947840 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa6065-f258-4a72-ba60-338043400fc4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.043341 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:52.067998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa6065-f258-4a72-ba60-338043400fc4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.071520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0535df9-34f7-4d01-8182-a5d5ddf293c9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.106335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57749259-a255-40da-b391-f4fec553255c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.106965 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57749259-a255-40da-b391-f4fec553255c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.107333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57749259-a255-40da-b391-f4fec553255c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.107609 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57749259-a255-40da-b391-f4fec553255c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.108215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a353b-911e-4c69-b6ac-fc63d7f232c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.108920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a353b-911e-4c69-b6ac-fc63d7f232c0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.109198 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a353b-911e-4c69-b6ac-fc63d7f232c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.109470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a353b-911e-4c69-b6ac-fc63d7f232c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.110130 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a353b-911e-4c69-b6ac-fc63d7f232c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:52.110434 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a353b-911e-4c69-b6ac-fc63d7f232c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.111788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a353b-911e-4c69-b6ac-fc63d7f232c0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:52.118048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57749259-a255-40da-b391-f4fec553255c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.119472 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57749259-a255-40da-b391-f4fec553255c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:52.128164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 288/569] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:52.128164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a353b-911e-4c69-b6ac-fc63d7f232c0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.131267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:52.137145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-57749259-a255-40da-b391-f4fec553255c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:52.137145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:52.137145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:52.137145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:52.137145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:52.137145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:52.137145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:52.137145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:52.137145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:52.137145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:52.137145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:52.137145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:52.137145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:52.137145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:52.137145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:52.137145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:52.138119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:52.138119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:52.138119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:52.138119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:52.138119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:52.138119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:52.138119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:52.138119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:52.138119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:52.138119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:52.138119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:52.138119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:52.138119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:52.138119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:52.138119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:52.138119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:52.138119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:52.139023 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:52.139023 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:52.139023 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:52.140468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 282/570] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:52.141379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57749259-a255-40da-b391-f4fec553255c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.244663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a353b-911e-4c69-b6ac-fc63d7f232c0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.248168 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57749259-a255-40da-b391-f4fec553255c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.276006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:52.280388 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ba4bd-f591-4514-9770-d9e0e297641c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.281034 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ba4bd-f591-4514-9770-d9e0e297641c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.281339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ba4bd-f591-4514-9770-d9e0e297641c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.281614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ba4bd-f591-4514-9770-d9e0e297641c None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.282282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ba4bd-f591-4514-9770-d9e0e297641c None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:52.282590 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ba4bd-f591-4514-9770-d9e0e297641c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.283971 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ba4bd-f591-4514-9770-d9e0e297641c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:52.284812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d952ee0-93bd-456a-aeea-90a0205b92af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.285578 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d952ee0-93bd-456a-aeea-90a0205b92af None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.285857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d952ee0-93bd-456a-aeea-90a0205b92af None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.286458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d952ee0-93bd-456a-aeea-90a0205b92af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.287182 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d952ee0-93bd-456a-aeea-90a0205b92af None admin] RBAC: Adding query filter params (role.id=ee7f9512e7e745199ff5ed847343d11a, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=35d0b95b22bc4117957cbc3afa5547a4) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:52.287488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d952ee0-93bd-456a-aeea-90a0205b92af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.289067 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d952ee0-93bd-456a-aeea-90a0205b92af None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:52.292226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 289/571] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:52 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:52.293402 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ba4bd-f591-4514-9770-d9e0e297641c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.296351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 283/572] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:11:52 2022] GET /identity/v3/role_assignments?user.id=35d0b95b22bc4117957cbc3afa5547a4&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=ee7f9512e7e745199ff5ed847343d11a => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:52.297170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d952ee0-93bd-456a-aeea-90a0205b92af None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.374191 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:52.420845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d952ee0-93bd-456a-aeea-90a0205b92af None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.425908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ba4bd-f591-4514-9770-d9e0e297641c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.462940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfdb04-83b6-48cd-b300-cc71f3669919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.463759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfdb04-83b6-48cd-b300-cc71f3669919 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.464041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfdb04-83b6-48cd-b300-cc71f3669919 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.464653 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfdb04-83b6-48cd-b300-cc71f3669919 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.465545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfdb04-83b6-48cd-b300-cc71f3669919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:52.465942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfdb04-83b6-48cd-b300-cc71f3669919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.467692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfdb04-83b6-48cd-b300-cc71f3669919 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:52.469201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49602fab-4521-4377-91a2-c5a158f82d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.469838 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49602fab-4521-4377-91a2-c5a158f82d35 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.470119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49602fab-4521-4377-91a2-c5a158f82d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.470708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49602fab-4521-4377-91a2-c5a158f82d35 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.478940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49602fab-4521-4377-91a2-c5a158f82d35 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.480398 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49602fab-4521-4377-91a2-c5a158f82d35 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:52.485137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 284/573] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:52.487259 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfdb04-83b6-48cd-b300-cc71f3669919 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.496179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-49602fab-4521-4377-91a2-c5a158f82d35 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:11:52.496179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:52.496179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:52.496179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:52.496179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:52.496179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:52.496179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:52.496179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:52.496179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:52.496179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:52.496179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:52.496179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:52.496179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:11:52.496179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:11:52.496179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:11:52.496179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:11:52.497330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:52.497330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:52.497330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:11:52.497330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:52.497330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:11:52.497330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:52.497330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:52.497330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:52.497330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:52.497330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:52.497330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:52.497330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:52.497330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:52.497330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:52.497330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:52.497330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:52.497330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:52.497330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:52.498347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:52.498347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:52.498347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:11:52.498347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:11:52.498347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:11:52.498347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:11:52.498347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:11:52.498347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:11:52.498347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:11:52.498347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:52.498347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 290/574] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:52.498929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49602fab-4521-4377-91a2-c5a158f82d35 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.548397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:52.598564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfdb04-83b6-48cd-b300-cc71f3669919 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.612951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49602fab-4521-4377-91a2-c5a158f82d35 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.635088 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067ba3d-66d2-48af-96f0-ce87cd038aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.635733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067ba3d-66d2-48af-96f0-ce87cd038aab None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.636019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067ba3d-66d2-48af-96f0-ce87cd038aab None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.636293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067ba3d-66d2-48af-96f0-ce87cd038aab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.639785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:52.646715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067ba3d-66d2-48af-96f0-ce87cd038aab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:52.652188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4067ba3d-66d2-48af-96f0-ce87cd038aab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:52.652188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:52.652188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:52.652188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:52.652188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:52.652188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:52.652188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:52.652188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:52.652188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:52.652188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:52.652188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:52.652188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:52.652188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:52.652188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:52.652188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:52.652188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:52.653463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:52.653463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:52.653463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:52.653463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:52.653463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:52.653463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:52.653463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:52.653463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:52.653463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:52.653463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:52.653463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:52.653463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:52.653463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:52.653463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:52.653463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:52.653463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:52.657680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:52.657680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:52.657680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:52.657680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:52.657680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:52.657680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:52.657680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:52.657680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:52.657680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:52.657680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:52.657680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:52.657680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:52.658317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e320b-4dd1-4771-8921-bd5667269538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.658407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 285/575] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:11:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:52.658482 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e320b-4dd1-4771-8921-bd5667269538 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.658482 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e320b-4dd1-4771-8921-bd5667269538 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.658482 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e320b-4dd1-4771-8921-bd5667269538 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.658677 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067ba3d-66d2-48af-96f0-ce87cd038aab None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.669881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e320b-4dd1-4771-8921-bd5667269538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.671671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e320b-4dd1-4771-8921-bd5667269538 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:52.687738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-9e6e320b-4dd1-4771-8921-bd5667269538 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:52.687738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:52.687738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:52.687738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:52.687738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:52.687738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:52.687738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:52.687738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:52.687738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:52.687738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:52.687738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:52.687738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:52.687738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:52.687738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:52.687738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:52.687738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:52.688906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:52.688906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:52.688906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:52.688906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:52.688906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:52.688906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:52.688906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:52.688906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:52.688906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:52.688906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:52.688906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:52.688906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:52.688906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:52.688906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:52.688906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:52.688906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:52.688906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:52.689978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:52.689978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:52.689978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:52.693458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 291/576] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:52.694825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e320b-4dd1-4771-8921-bd5667269538 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.767687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067ba3d-66d2-48af-96f0-ce87cd038aab None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.782185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:52.806380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66baeefb-59ac-49d7-bb8f-67277aecd7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.807060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baeefb-59ac-49d7-bb8f-67277aecd7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.807168 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e320b-4dd1-4771-8921-bd5667269538 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.807341 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baeefb-59ac-49d7-bb8f-67277aecd7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.807601 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baeefb-59ac-49d7-bb8f-67277aecd7a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.815767 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66baeefb-59ac-49d7-bb8f-67277aecd7a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.817360 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66baeefb-59ac-49d7-bb8f-67277aecd7a0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:52.831240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-66baeefb-59ac-49d7-bb8f-67277aecd7a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:11:52.831240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:52.831240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:52.831240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:52.831240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:52.831240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:52.831240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:52.831240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:52.831240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:52.831240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:52.831240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:52.831240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:52.831240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:11:52.831240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:11:52.831240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:11:52.831240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:11:52.832268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:52.832268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:52.832268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:11:52.832268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:52.832268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:11:52.832268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:52.832268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:52.832268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:52.832268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:52.832268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:52.832268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:52.832268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:52.832268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:52.832268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:52.832268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:52.832268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:52.832268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:52.832268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:52.833628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:52.833628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:52.833628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:11:52.833628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:11:52.833628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:11:52.833628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:11:52.833628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:11:52.833628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:11:52.833628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:11:52.833628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:52.833628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 286/577] 10.222.0.107 () {56 vars in 1098 bytes} [Tue Aug 23 23:11:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:52.833628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66baeefb-59ac-49d7-bb8f-67277aecd7a0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.850862 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d5fcd-c5b0-4f91-8e85-ddfcbde8d6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.851685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d5fcd-c5b0-4f91-8e85-ddfcbde8d6ed None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.851987 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d5fcd-c5b0-4f91-8e85-ddfcbde8d6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.852241 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d5fcd-c5b0-4f91-8e85-ddfcbde8d6ed None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.853046 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d5fcd-c5b0-4f91-8e85-ddfcbde8d6ed None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:52.853352 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d5fcd-c5b0-4f91-8e85-ddfcbde8d6ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.854842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d5fcd-c5b0-4f91-8e85-ddfcbde8d6ed None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:52.874038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 292/578] 10.222.0.107 () {56 vars in 1142 bytes} [Tue Aug 23 23:11:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:52.879183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d5fcd-c5b0-4f91-8e85-ddfcbde8d6ed None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:52.914726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:52.946883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66baeefb-59ac-49d7-bb8f-67277aecd7a0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.988141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cab22-eb7a-4be9-96aa-4e62c13e4d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:52.988917 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cab22-eb7a-4be9-96aa-4e62c13e4d0a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:52.989290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cab22-eb7a-4be9-96aa-4e62c13e4d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:52.989519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d5fcd-c5b0-4f91-8e85-ddfcbde8d6ed None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:52.989735 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cab22-eb7a-4be9-96aa-4e62c13e4d0a None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:52.990490 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cab22-eb7a-4be9-96aa-4e62c13e4d0a None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:52.995103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cab22-eb7a-4be9-96aa-4e62c13e4d0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:52.996640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cab22-eb7a-4be9-96aa-4e62c13e4d0a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:53.006084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 287/579] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:52 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:53.006084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cab22-eb7a-4be9-96aa-4e62c13e4d0a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:53.034138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905e3c9-174d-480e-b26f-cd2cfd7aa4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:53.034831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905e3c9-174d-480e-b26f-cd2cfd7aa4bb None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:53.035021 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905e3c9-174d-480e-b26f-cd2cfd7aa4bb None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:53.035281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905e3c9-174d-480e-b26f-cd2cfd7aa4bb None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:53.035914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905e3c9-174d-480e-b26f-cd2cfd7aa4bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:53.036214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905e3c9-174d-480e-b26f-cd2cfd7aa4bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:53.037663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905e3c9-174d-480e-b26f-cd2cfd7aa4bb None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:53.045984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:53.050980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 293/580] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:53.051795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905e3c9-174d-480e-b26f-cd2cfd7aa4bb None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:53.125528 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cab22-eb7a-4be9-96aa-4e62c13e4d0a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:53.158435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:53.164378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48988131-3556-42a8-ad73-c04f74fca353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:53.165136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48988131-3556-42a8-ad73-c04f74fca353 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:53.165363 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48988131-3556-42a8-ad73-c04f74fca353 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:53.165632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48988131-3556-42a8-ad73-c04f74fca353 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:53.166099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905e3c9-174d-480e-b26f-cd2cfd7aa4bb None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:53.166417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48988131-3556-42a8-ad73-c04f74fca353 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:53.166726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48988131-3556-42a8-ad73-c04f74fca353 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:53.168457 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48988131-3556-42a8-ad73-c04f74fca353 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:53.192307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 288/581] 10.222.0.107 () {56 vars in 1138 bytes} [Tue Aug 23 23:11:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:53.192307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48988131-3556-42a8-ad73-c04f74fca353 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:53.207645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b415bb-c691-4893-a63f-e136692f42bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:53.208533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b415bb-c691-4893-a63f-e136692f42bf None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:53.208848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b415bb-c691-4893-a63f-e136692f42bf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:53.209117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b415bb-c691-4893-a63f-e136692f42bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:53.220682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b415bb-c691-4893-a63f-e136692f42bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:53.222086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b415bb-c691-4893-a63f-e136692f42bf None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:53.236722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-93b415bb-c691-4893-a63f-e136692f42bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:53.236722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:53.236722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:53.236722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:53.236722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:53.236722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:53.236722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:53.236722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:53.236722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:53.236722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:53.236722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:53.236722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:53.236722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:53.236722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:53.236722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:53.236722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:53.238250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:53.238250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:53.238250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:53.238250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:53.238250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:53.238250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:53.238250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:53.238250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:53.238250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:53.238250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:53.238250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:53.238250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:53.238250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:53.238250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:53.238250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:53.238250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:53.238250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:53.239593 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:53.239593 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:53.239593 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:53.239593 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 294/582] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:53.239593 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b415bb-c691-4893-a63f-e136692f42bf None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:53.297965 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:53.309590 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48988131-3556-42a8-ad73-c04f74fca353 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:53.352017 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae7453-9651-4b8d-8f2d-69e1fe8b0647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:53.352681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae7453-9651-4b8d-8f2d-69e1fe8b0647 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:53.353120 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae7453-9651-4b8d-8f2d-69e1fe8b0647 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:53.353402 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae7453-9651-4b8d-8f2d-69e1fe8b0647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:53.358714 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b415bb-c691-4893-a63f-e136692f42bf None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:53.368717 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae7453-9651-4b8d-8f2d-69e1fe8b0647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:53.370180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae7453-9651-4b8d-8f2d-69e1fe8b0647 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:53.386027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8fae7453-9651-4b8d-8f2d-69e1fe8b0647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:53.386027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:53.386027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:53.386027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:53.386027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:53.386027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:53.386027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:53.386027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:53.386027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:53.386027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:53.386027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:53.386027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:53.386027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:53.386027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:53.386027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:53.386027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:53.387050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:53.387050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:53.387050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:53.387050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:53.387050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:53.387050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:53.387050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:53.387050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:53.387050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:53.387050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:53.387050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:53.387050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:53.387050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:53.387050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:53.387050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:53.387050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:53.387050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:53.387933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:53.387933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:53.387933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:53.387933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 289/583] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:53.388161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae7453-9651-4b8d-8f2d-69e1fe8b0647 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:53.405344 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6851551-3fae-43b3-857a-a15ab3539160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:53.405993 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6851551-3fae-43b3-857a-a15ab3539160 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:53.406444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6851551-3fae-43b3-857a-a15ab3539160 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:53.406723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6851551-3fae-43b3-857a-a15ab3539160 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:53.417406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6851551-3fae-43b3-857a-a15ab3539160 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:53.419697 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6851551-3fae-43b3-857a-a15ab3539160 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:53.433277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d6851551-3fae-43b3-857a-a15ab3539160 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:11:53.433277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:53.433277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:53.433277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:53.433277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:53.433277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:53.433277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:53.433277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:53.433277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:53.433277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:53.433277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:53.433277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:53.433277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:11:53.433277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:11:53.433277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:11:53.433277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:11:53.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:53.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:53.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:11:53.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:53.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:11:53.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:53.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:53.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:53.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:53.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:53.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:53.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:53.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:53.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:53.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:53.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:53.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:53.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:53.435170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:53.435170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:53.435170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:11:53.435170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:11:53.435170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:11:53.435170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:11:53.435170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:11:53.435170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:11:53.435170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:11:53.435170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:53.435170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 295/584] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:53.435170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6851551-3fae-43b3-857a-a15ab3539160 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:53.449832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:53.502559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae7453-9651-4b8d-8f2d-69e1fe8b0647 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:53.540416 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a212e4d-512d-40f2-a54c-d23e7dd6a5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:53.541080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a212e4d-512d-40f2-a54c-d23e7dd6a5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:53.541362 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a212e4d-512d-40f2-a54c-d23e7dd6a5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:53.541635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a212e4d-512d-40f2-a54c-d23e7dd6a5c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:53.552435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a212e4d-512d-40f2-a54c-d23e7dd6a5c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:53.554042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a212e4d-512d-40f2-a54c-d23e7dd6a5c3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:53.556922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:53.558068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6851551-3fae-43b3-857a-a15ab3539160 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:53.571900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8a212e4d-512d-40f2-a54c-d23e7dd6a5c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:53.571900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:53.571900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:53.571900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:53.571900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:53.571900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:53.571900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:53.571900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:53.571900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:53.571900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:53.571900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:53.571900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:53.571900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:53.571900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:53.571900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:53.571900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:53.573502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:53.573502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:53.573502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:53.573502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:53.573502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:53.573502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:53.573502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:53.573502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:53.573502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:53.573502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:53.573502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:53.573502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:53.573502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:53.573502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:53.573502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:53.573502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:53.573502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:53.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:53.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:53.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:53.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 290/585] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:53.574755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a212e4d-512d-40f2-a54c-d23e7dd6a5c3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:53.599533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d8bcb-1b0f-4a8a-b32d-d6492233a7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:53.600209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d8bcb-1b0f-4a8a-b32d-d6492233a7ed None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:53.600552 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d8bcb-1b0f-4a8a-b32d-d6492233a7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:53.600855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d8bcb-1b0f-4a8a-b32d-d6492233a7ed None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:53.601497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d8bcb-1b0f-4a8a-b32d-d6492233a7ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:53.601797 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d8bcb-1b0f-4a8a-b32d-d6492233a7ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:53.603155 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d8bcb-1b0f-4a8a-b32d-d6492233a7ed None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:53.628548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 296/586] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:53.628548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d8bcb-1b0f-4a8a-b32d-d6492233a7ed None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:53.701105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a212e4d-512d-40f2-a54c-d23e7dd6a5c3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:53.707391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:53.737625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772bc3e-d639-4c45-963e-ec38a01f2531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:53.738230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772bc3e-d639-4c45-963e-ec38a01f2531 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:53.738520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772bc3e-d639-4c45-963e-ec38a01f2531 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:53.738780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772bc3e-d639-4c45-963e-ec38a01f2531 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:53.739415 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772bc3e-d639-4c45-963e-ec38a01f2531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:53.739716 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772bc3e-d639-4c45-963e-ec38a01f2531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:53.741748 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772bc3e-d639-4c45-963e-ec38a01f2531 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:53.745029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d8bcb-1b0f-4a8a-b32d-d6492233a7ed None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:53.758700 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 291/587] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:53.758700 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772bc3e-d639-4c45-963e-ec38a01f2531 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:53.786042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d32a38-7f39-46fe-85a1-13e866493a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:53.786663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d32a38-7f39-46fe-85a1-13e866493a9e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:53.786941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d32a38-7f39-46fe-85a1-13e866493a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:53.787222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d32a38-7f39-46fe-85a1-13e866493a9e None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:53.788499 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d32a38-7f39-46fe-85a1-13e866493a9e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:53.788834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d32a38-7f39-46fe-85a1-13e866493a9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:53.790432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d32a38-7f39-46fe-85a1-13e866493a9e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:53.809949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 297/588] 10.222.0.107 () {56 vars in 1142 bytes} [Tue Aug 23 23:11:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:53.811587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d32a38-7f39-46fe-85a1-13e866493a9e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:53.822909 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:53.874275 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772bc3e-d639-4c45-963e-ec38a01f2531 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:53.911478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50ec42-dabc-4e47-920e-7dd8b8855319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:53.912087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50ec42-dabc-4e47-920e-7dd8b8855319 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:53.912364 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50ec42-dabc-4e47-920e-7dd8b8855319 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:53.912720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50ec42-dabc-4e47-920e-7dd8b8855319 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:53.913471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50ec42-dabc-4e47-920e-7dd8b8855319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:53.913890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50ec42-dabc-4e47-920e-7dd8b8855319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:53.915178 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50ec42-dabc-4e47-920e-7dd8b8855319 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:53.921226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d32a38-7f39-46fe-85a1-13e866493a9e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:53.927658 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 292/589] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:53.928839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50ec42-dabc-4e47-920e-7dd8b8855319 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:53.954650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:53.969802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b9743-fe1c-4ab6-8af5-8f224b26f129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:53.970435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b9743-fe1c-4ab6-8af5-8f224b26f129 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:53.970719 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b9743-fe1c-4ab6-8af5-8f224b26f129 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:53.970989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b9743-fe1c-4ab6-8af5-8f224b26f129 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:53.978399 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b9743-fe1c-4ab6-8af5-8f224b26f129 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:53.980143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b9743-fe1c-4ab6-8af5-8f224b26f129 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:53.995524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-4b4b9743-fe1c-4ab6-8af5-8f224b26f129 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:53.995524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:53.995524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:53.995524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:53.995524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:53.995524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:53.995524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:53.995524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:53.995524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:53.995524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:53.995524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:53.995524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:53.995524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:11:53.995524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:11:53.995524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:11:53.996536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:11:53.996536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:53.996536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:53.996536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:53.996536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:53.996536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:53.996536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:53.996536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:53.996536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:53.996536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:53.996536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:53.996536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:53.996536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:53.996536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:53.996536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:53.996536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:53.996536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:53.998863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:11:53.998863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:11:53.998863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:11:53.998863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:11:53.998863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:11:53.998863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:11:53.998863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:53.998863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:53.998863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 298/590] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:53.998863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b9743-fe1c-4ab6-8af5-8f224b26f129 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:54.052868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50ec42-dabc-4e47-920e-7dd8b8855319 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:54.076464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:54.094824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54ffcd-a5eb-4d85-a957-331314db99eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:54.095623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54ffcd-a5eb-4d85-a957-331314db99eb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:54.096062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54ffcd-a5eb-4d85-a957-331314db99eb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:54.096364 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54ffcd-a5eb-4d85-a957-331314db99eb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:54.105414 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54ffcd-a5eb-4d85-a957-331314db99eb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:54.106991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54ffcd-a5eb-4d85-a957-331314db99eb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:54.114296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b9743-fe1c-4ab6-8af5-8f224b26f129 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:54.119546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-ec54ffcd-a5eb-4d85-a957-331314db99eb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:11:54.119546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:54.119546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:54.119546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:54.119546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:54.119546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:54.119546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:54.119546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:54.119546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:54.119546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:54.119546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:54.119546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:54.119546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:11:54.119546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:11:54.119546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:11:54.119546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:11:54.120737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:54.120737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:54.120737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:11:54.120737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:54.120737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:11:54.120737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:54.120737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:54.120737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:54.120737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:54.120737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:54.120737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:54.120737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:54.120737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:54.120737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:54.120737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:54.120737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:54.120737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:54.120737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:54.121910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:54.121910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:54.121910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:11:54.121910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:11:54.121910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:11:54.121910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:11:54.121910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:11:54.121910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:11:54.121910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:11:54.121910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:54.128505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 293/591] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:11:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:54.128505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54ffcd-a5eb-4d85-a957-331314db99eb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:54.158615 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2dcb3-374e-46cd-bf38-ef16d9b0b4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:54.159948 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2dcb3-374e-46cd-bf38-ef16d9b0b4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:54.160539 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2dcb3-374e-46cd-bf38-ef16d9b0b4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:54.160998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2dcb3-374e-46cd-bf38-ef16d9b0b4e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:54.173245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2dcb3-374e-46cd-bf38-ef16d9b0b4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:54.174603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2dcb3-374e-46cd-bf38-ef16d9b0b4e2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:54.190827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-b0d2dcb3-374e-46cd-bf38-ef16d9b0b4e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:54.190827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:54.190827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:54.190827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:54.190827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:54.190827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:54.190827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:54.190827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:54.190827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:54.190827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:54.190827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:54.190827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:54.190827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:54.190827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:54.190827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:54.190827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:54.191834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:54.191834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:54.191834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:54.191834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:54.191834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:54.191834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:54.191834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:54.191834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:54.191834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:54.191834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:54.191834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:54.191834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:54.191834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:54.191834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:54.191834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:54.191834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:54.191834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:54.192768 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:54.192768 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:54.192768 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:54.192768 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 299/592] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:54.192768 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2dcb3-374e-46cd-bf38-ef16d9b0b4e2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:54.233407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:54.245971 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54ffcd-a5eb-4d85-a957-331314db99eb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:54.282593 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe44e83-89c0-48f6-9ff0-ff73f58bfc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:54.283673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe44e83-89c0-48f6-9ff0-ff73f58bfc0c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:54.284161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe44e83-89c0-48f6-9ff0-ff73f58bfc0c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:54.284447 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe44e83-89c0-48f6-9ff0-ff73f58bfc0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:54.292944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe44e83-89c0-48f6-9ff0-ff73f58bfc0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:54.294430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe44e83-89c0-48f6-9ff0-ff73f58bfc0c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:54.302874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2dcb3-374e-46cd-bf38-ef16d9b0b4e2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:54.305650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2fe44e83-89c0-48f6-9ff0-ff73f58bfc0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:54.305650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:54.305650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:54.305650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:54.305650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:54.305650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:54.305650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:54.305650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:54.305650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:54.305650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:54.305650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:54.305650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:54.305650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:11:54.305650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:11:54.305650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:11:54.306579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:11:54.306579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:54.306579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:54.306579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:54.306579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:54.306579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:54.306579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:54.306579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:54.306579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:54.306579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:54.306579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:54.306579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:54.306579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:54.306579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:54.306579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:54.306579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:54.306579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:54.307470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:11:54.307470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:11:54.307470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:11:54.307470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:11:54.307470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:11:54.307470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:11:54.307470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:54.307470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:54.307470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 294/593] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:54.307961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe44e83-89c0-48f6-9ff0-ff73f58bfc0c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:54.339426 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d21b5d-9a4f-4b91-89d8-08b481aa0da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:54.340029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d21b5d-9a4f-4b91-89d8-08b481aa0da3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:54.340306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d21b5d-9a4f-4b91-89d8-08b481aa0da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:54.340587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d21b5d-9a4f-4b91-89d8-08b481aa0da3 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:54.341310 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d21b5d-9a4f-4b91-89d8-08b481aa0da3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:54.341639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d21b5d-9a4f-4b91-89d8-08b481aa0da3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:54.343039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d21b5d-9a4f-4b91-89d8-08b481aa0da3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:54.347120 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:54.355654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 300/594] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:11:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:54.356481 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d21b5d-9a4f-4b91-89d8-08b481aa0da3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:54.418429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe44e83-89c0-48f6-9ff0-ff73f58bfc0c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:54.452661 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:54.453497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1336e-a10e-4f3d-bc72-c450e4ca9b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:54.454378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1336e-a10e-4f3d-bc72-c450e4ca9b8c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:54.454715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1336e-a10e-4f3d-bc72-c450e4ca9b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:54.454987 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1336e-a10e-4f3d-bc72-c450e4ca9b8c None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:54.455725 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1336e-a10e-4f3d-bc72-c450e4ca9b8c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:54.456332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1336e-a10e-4f3d-bc72-c450e4ca9b8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:54.457479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1336e-a10e-4f3d-bc72-c450e4ca9b8c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:54.458859 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d21b5d-9a4f-4b91-89d8-08b481aa0da3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:54.475831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 295/595] 10.222.0.107 () {56 vars in 1144 bytes} [Tue Aug 23 23:11:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:54.477177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff187f-a3fd-478f-ad52-eaaef2c8eb07 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:54.477455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff187f-a3fd-478f-ad52-eaaef2c8eb07 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:54.477723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff187f-a3fd-478f-ad52-eaaef2c8eb07 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:54.480737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 296/596] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:54.480737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff187f-a3fd-478f-ad52-eaaef2c8eb07 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:54.496995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197da97-cb60-4d30-adec-cfd60ab1a68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:54.497530 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197da97-cb60-4d30-adec-cfd60ab1a68a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:54.497809 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197da97-cb60-4d30-adec-cfd60ab1a68a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:54.498085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197da97-cb60-4d30-adec-cfd60ab1a68a None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:54.498727 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197da97-cb60-4d30-adec-cfd60ab1a68a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:54.499036 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197da97-cb60-4d30-adec-cfd60ab1a68a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:54.500405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197da97-cb60-4d30-adec-cfd60ab1a68a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:54.512270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 301/597] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:54.513144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197da97-cb60-4d30-adec-cfd60ab1a68a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:54.579478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:54.587736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff187f-a3fd-478f-ad52-eaaef2c8eb07 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:54.617864 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197da97-cb60-4d30-adec-cfd60ab1a68a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:54.624375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c47ce5-1f71-4b49-9cc4-761f2ddc0019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:54.625016 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c47ce5-1f71-4b49-9cc4-761f2ddc0019 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:54.625302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c47ce5-1f71-4b49-9cc4-761f2ddc0019 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:54.625573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c47ce5-1f71-4b49-9cc4-761f2ddc0019 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:54.626263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c47ce5-1f71-4b49-9cc4-761f2ddc0019 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:54.626571 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c47ce5-1f71-4b49-9cc4-761f2ddc0019 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:54.628000 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c47ce5-1f71-4b49-9cc4-761f2ddc0019 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:54.640656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 297/598] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:11:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:54.641304 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c47ce5-1f71-4b49-9cc4-761f2ddc0019 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:54.658635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96758eaf-7792-4bdc-b3f3-4f1d95e00558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:54.659298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96758eaf-7792-4bdc-b3f3-4f1d95e00558 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:54.659579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96758eaf-7792-4bdc-b3f3-4f1d95e00558 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:54.659847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96758eaf-7792-4bdc-b3f3-4f1d95e00558 None admin] PATH_INFO: `/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/8937ae9f5c7840a2a5af5f851d02ea77/roles/ee7f9512e7e745199ff5ed847343d11a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:54.679377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96758eaf-7792-4bdc-b3f3-4f1d95e00558 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7cdd07c79614516be35aa2d82ec6a3b, user_id=8937ae9f5c7840a2a5af5f851d02ea77, role_id=ee7f9512e7e745199ff5ed847343d11a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:54.681082 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96758eaf-7792-4bdc-b3f3-4f1d95e00558 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:54.695006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 302/599] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:11:54 2022] PUT /identity/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/8937ae9f5c7840a2a5af5f851d02ea77/roles/ee7f9512e7e745199ff5ed847343d11a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:54.696236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96139f-a642-4686-b6f7-0d099c66b160 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:54.696521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96139f-a642-4686-b6f7-0d099c66b160 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:54.696816 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96139f-a642-4686-b6f7-0d099c66b160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:54.715505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:54.723143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3a96139f-a642-4686-b6f7-0d099c66b160 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:54.725412 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3a96139f-a642-4686-b6f7-0d099c66b160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:54.761014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c47ce5-1f71-4b49-9cc4-761f2ddc0019 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:54.800132 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f94ae2-ee3e-41ba-a783-615f4c8a204b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:54.801101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f94ae2-ee3e-41ba-a783-615f4c8a204b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:54.801548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f94ae2-ee3e-41ba-a783-615f4c8a204b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:54.801928 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f94ae2-ee3e-41ba-a783-615f4c8a204b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:54.808703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 303/600] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:54.808703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96139f-a642-4686-b6f7-0d099c66b160 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:54.815319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f94ae2-ee3e-41ba-a783-615f4c8a204b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:54.817079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f94ae2-ee3e-41ba-a783-615f4c8a204b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:54.834340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f8f94ae2-ee3e-41ba-a783-615f4c8a204b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:54.834340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:54.834340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:54.834340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:54.834340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:54.834340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:54.834340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:54.834340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:54.834340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:54.834340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:54.834340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:54.834340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:54.834340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:54.834340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:54.834340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:54.834340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:54.835908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:54.835908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:54.835908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:54.835908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:54.835908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:54.835908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:54.835908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:54.835908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:54.835908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:54.835908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:54.835908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:54.835908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:54.835908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:54.835908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:54.835908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:54.835908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:54.835908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:54.837180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:54.837180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:54.837180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:54.838605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 298/601] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:54.839347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f94ae2-ee3e-41ba-a783-615f4c8a204b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:54.850853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:54.945346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96139f-a642-4686-b6f7-0d099c66b160 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:54.964689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f94ae2-ee3e-41ba-a783-615f4c8a204b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:54.981517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccddf2c-606c-4793-8003-b61eb9b44dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:54.982533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccddf2c-606c-4793-8003-b61eb9b44dea None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:54.983016 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccddf2c-606c-4793-8003-b61eb9b44dea None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:54.983540 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccddf2c-606c-4793-8003-b61eb9b44dea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:54.986643 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:54.992860 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccddf2c-606c-4793-8003-b61eb9b44dea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:54.994684 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccddf2c-606c-4793-8003-b61eb9b44dea None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:55.005267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c185a6e-4b4a-4b4c-a3de-f32bb3526748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:55.005932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c185a6e-4b4a-4b4c-a3de-f32bb3526748 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:55.006211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c185a6e-4b4a-4b4c-a3de-f32bb3526748 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:55.007054 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c185a6e-4b4a-4b4c-a3de-f32bb3526748 None admin] PATH_INFO: `/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/2f985626d8af4f3089e72998fad98b47/roles/ee7f9512e7e745199ff5ed847343d11a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:55.010598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-9ccddf2c-606c-4793-8003-b61eb9b44dea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:55.010598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:55.010598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:55.010598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:55.010598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:55.010598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:55.010598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:55.010598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:55.010598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:55.010598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:55.010598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:55.010598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:55.010598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:11:55.010598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:11:55.010598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:11:55.011712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:11:55.011712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:55.011712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:55.011712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:55.011712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:55.011712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:55.011712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:55.011712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:55.011712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:55.011712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:55.011712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:55.011712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:55.011712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:55.011712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:55.011712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:55.011712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:55.011712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:55.012746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:11:55.012746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:11:55.012746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:11:55.012746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:11:55.012746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:11:55.012746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:11:55.012746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:55.012746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:55.014681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 304/602] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:55.015730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccddf2c-606c-4793-8003-b61eb9b44dea None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:55.027452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c185a6e-4b4a-4b4c-a3de-f32bb3526748 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7cdd07c79614516be35aa2d82ec6a3b, user_id=2f985626d8af4f3089e72998fad98b47, role_id=ee7f9512e7e745199ff5ed847343d11a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:55.029650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c185a6e-4b4a-4b4c-a3de-f32bb3526748 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:55.049133 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 299/603] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:11:54 2022] PUT /identity/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/2f985626d8af4f3089e72998fad98b47/roles/ee7f9512e7e745199ff5ed847343d11a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:55.053223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c185a6e-4b4a-4b4c-a3de-f32bb3526748 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:55.142504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:55.167033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccddf2c-606c-4793-8003-b61eb9b44dea None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:55.197199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c185a6e-4b4a-4b4c-a3de-f32bb3526748 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:55.206948 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e1a3d-0fc1-48bd-84f6-139036249290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:55.207569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e1a3d-0fc1-48bd-84f6-139036249290 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:55.207844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e1a3d-0fc1-48bd-84f6-139036249290 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:55.208113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e1a3d-0fc1-48bd-84f6-139036249290 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:55.208811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e1a3d-0fc1-48bd-84f6-139036249290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:55.209621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e1a3d-0fc1-48bd-84f6-139036249290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:55.211223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e1a3d-0fc1-48bd-84f6-139036249290 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:55.224460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 305/604] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:55.225746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e1a3d-0fc1-48bd-84f6-139036249290 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:55.238050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e2204-13f2-44b3-a512-b8cfc396909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:55.238666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e2204-13f2-44b3-a512-b8cfc396909b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:55.238947 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e2204-13f2-44b3-a512-b8cfc396909b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:55.239223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e2204-13f2-44b3-a512-b8cfc396909b None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:55.239929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e2204-13f2-44b3-a512-b8cfc396909b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:55.240236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e2204-13f2-44b3-a512-b8cfc396909b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:55.241797 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e2204-13f2-44b3-a512-b8cfc396909b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:55.255783 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 300/605] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:11:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:55.257189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e2204-13f2-44b3-a512-b8cfc396909b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:55.301171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:55.364635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e1a3d-0fc1-48bd-84f6-139036249290 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:55.381228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e2204-13f2-44b3-a512-b8cfc396909b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:55.400650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:55.417422 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaa3bd-4129-4c36-9145-29b69109f6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:55.418976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaa3bd-4129-4c36-9145-29b69109f6cc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:55.419413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaa3bd-4129-4c36-9145-29b69109f6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:55.419829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaa3bd-4129-4c36-9145-29b69109f6cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:55.422353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd2ebd-c21a-414d-ac2d-975ca8edcc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:55.423099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd2ebd-c21a-414d-ac2d-975ca8edcc53 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:55.423484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd2ebd-c21a-414d-ac2d-975ca8edcc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:55.423692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd2ebd-c21a-414d-ac2d-975ca8edcc53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:55.432033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd2ebd-c21a-414d-ac2d-975ca8edcc53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:55.433572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd2ebd-c21a-414d-ac2d-975ca8edcc53 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:55.434027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eaa3bd-4129-4c36-9145-29b69109f6cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:55.440428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d6eaa3bd-4129-4c36-9145-29b69109f6cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:55.440428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:55.440428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:55.440428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:55.440428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:55.440428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:55.440428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:55.440428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:55.440428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:55.440428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:55.440428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:55.440428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:55.440428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:55.440428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:55.440428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:55.440428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:55.441598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:55.441598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:55.441598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:55.441598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:55.441598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:55.441598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:55.441598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:55.441598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:55.441598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:55.441598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:55.441598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:55.441598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:55.441598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:55.441598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:55.441598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:55.441598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:55.442572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:55.442572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:55.442572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:55.442572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:55.442572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:55.442572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:55.442572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:55.442572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:55.442572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:55.442572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:55.442572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:55.442572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:55.449944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-6afd2ebd-c21a-414d-ac2d-975ca8edcc53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:55.449944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:55.449944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:55.449944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:55.449944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:55.449944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:55.449944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:55.449944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:55.449944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:55.449944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:55.449944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:55.449944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:55.449944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:11:55.449944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:11:55.449944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:11:55.451062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:11:55.451062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:55.451062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:55.451062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:55.451062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:55.451062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:55.451062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:55.451062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:55.451062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:55.451062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:55.451062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:55.451062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:55.451062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:55.451062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:55.451062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:55.451062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:55.451062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:55.452425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:11:55.452425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:11:55.452425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:11:55.452425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:11:55.452425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:11:55.452425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:11:55.452425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:55.452425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:55.452425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 301/607] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:55.452425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd2ebd-c21a-414d-ac2d-975ca8edcc53 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:55.453174 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 306/607] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:11:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:55.454206 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaa3bd-4129-4c36-9145-29b69109f6cc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:55.567351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd2ebd-c21a-414d-ac2d-975ca8edcc53 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:55.569699 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaa3bd-4129-4c36-9145-29b69109f6cc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:55.587692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:55.609429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661601d-dc93-4416-8960-4cefc380e065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:55.610348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661601d-dc93-4416-8960-4cefc380e065 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:55.610878 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661601d-dc93-4416-8960-4cefc380e065 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:55.611299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661601d-dc93-4416-8960-4cefc380e065 None admin] PATH_INFO: `/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/a43ac193836248959a0380a76549ec10/roles/ee7f9512e7e745199ff5ed847343d11a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:55.611534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f73fc-3fc1-4a24-8c61-807ad9263703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:55.612238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f73fc-3fc1-4a24-8c61-807ad9263703 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:55.612636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f73fc-3fc1-4a24-8c61-807ad9263703 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:55.613033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f73fc-3fc1-4a24-8c61-807ad9263703 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:55.613827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f73fc-3fc1-4a24-8c61-807ad9263703 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:55.614234 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f73fc-3fc1-4a24-8c61-807ad9263703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:55.615810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f73fc-3fc1-4a24-8c61-807ad9263703 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:55.629060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 307/608] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:11:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:55.630150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f73fc-3fc1-4a24-8c61-807ad9263703 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:55.631205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661601d-dc93-4416-8960-4cefc380e065 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7cdd07c79614516be35aa2d82ec6a3b, user_id=a43ac193836248959a0380a76549ec10, role_id=ee7f9512e7e745199ff5ed847343d11a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:55.633502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661601d-dc93-4416-8960-4cefc380e065 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:55.655648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 302/609] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:11:55 2022] PUT /identity/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/a43ac193836248959a0380a76549ec10/roles/ee7f9512e7e745199ff5ed847343d11a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:55.657265 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661601d-dc93-4416-8960-4cefc380e065 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:55.710020 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:55.766594 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f73fc-3fc1-4a24-8c61-807ad9263703 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:55.794476 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661601d-dc93-4416-8960-4cefc380e065 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:55.807733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdeba1-a1d0-414c-8efa-91bbe8d663b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:55.808529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdeba1-a1d0-414c-8efa-91bbe8d663b0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:55.808945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdeba1-a1d0-414c-8efa-91bbe8d663b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:55.809330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdeba1-a1d0-414c-8efa-91bbe8d663b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:55.810133 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdeba1-a1d0-414c-8efa-91bbe8d663b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:55.810568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdeba1-a1d0-414c-8efa-91bbe8d663b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:55.812132 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdeba1-a1d0-414c-8efa-91bbe8d663b0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:55.824745 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 308/610] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:55 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:55.837972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdeba1-a1d0-414c-8efa-91bbe8d663b0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:55.839893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469a9c3-adfe-4639-8955-3f5d672fff3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:55.840577 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469a9c3-adfe-4639-8955-3f5d672fff3a None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:55.840890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469a9c3-adfe-4639-8955-3f5d672fff3a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:55.841161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469a9c3-adfe-4639-8955-3f5d672fff3a None admin] PATH_INFO: `/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/b88d0d18ad66438191541b84fc1431bf/roles/ee7f9512e7e745199ff5ed847343d11a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:55.858422 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469a9c3-adfe-4639-8955-3f5d672fff3a None admin] RBAC: Authorizing `identity:create_grant(project_id=f7cdd07c79614516be35aa2d82ec6a3b, user_id=b88d0d18ad66438191541b84fc1431bf, role_id=ee7f9512e7e745199ff5ed847343d11a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:55.859893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469a9c3-adfe-4639-8955-3f5d672fff3a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:55.888634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 303/611] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:11:55 2022] PUT /identity/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/b88d0d18ad66438191541b84fc1431bf/roles/ee7f9512e7e745199ff5ed847343d11a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:55.919800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:56.001190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdeba1-a1d0-414c-8efa-91bbe8d663b0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:56.041891 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d6f9c-c23b-4528-acbd-8d899a2a099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:56.042594 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d6f9c-c23b-4528-acbd-8d899a2a099d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.043177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d6f9c-c23b-4528-acbd-8d899a2a099d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.043452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d6f9c-c23b-4528-acbd-8d899a2a099d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.054859 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d6f9c-c23b-4528-acbd-8d899a2a099d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:56.056322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d6f9c-c23b-4528-acbd-8d899a2a099d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:56.072459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-606d6f9c-c23b-4528-acbd-8d899a2a099d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:56.072459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:56.072459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:56.072459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:56.072459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:56.072459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:56.072459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:56.072459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:56.072459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:56.072459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:56.072459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:56.072459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:56.072459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:56.072459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:56.072459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:56.072459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:56.073639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:56.073639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:56.073639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:56.073639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:56.073639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:56.073639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:56.073639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:56.073639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:56.073639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:56.073639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:56.073639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:56.073639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:56.073639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:56.073639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:56.073639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:56.073639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:56.073639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:56.074842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:56.074842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:56.074842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:56.074842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 309/612] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:11:56.080805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469a9c3-adfe-4639-8955-3f5d672fff3a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:56.164852 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:56.193480 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469a9c3-adfe-4639-8955-3f5d672fff3a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:56.233203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981ced3-d231-4287-9141-9eacf0a2207e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:56.233810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981ced3-d231-4287-9141-9eacf0a2207e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.234085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981ced3-d231-4287-9141-9eacf0a2207e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.234353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981ced3-d231-4287-9141-9eacf0a2207e None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.235002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981ced3-d231-4287-9141-9eacf0a2207e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:56.235299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981ced3-d231-4287-9141-9eacf0a2207e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:56.236678 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981ced3-d231-4287-9141-9eacf0a2207e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:56.254183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 304/613] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:56.258284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d6f9c-c23b-4528-acbd-8d899a2a099d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:56.405238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:56.416394 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d6f9c-c23b-4528-acbd-8d899a2a099d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:56.460922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d6b62-883e-4775-aa5b-d84f4857a8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:56.461578 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d6b62-883e-4775-aa5b-d84f4857a8cd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.461861 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d6b62-883e-4775-aa5b-d84f4857a8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.462141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d6b62-883e-4775-aa5b-d84f4857a8cd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.470525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d6b62-883e-4775-aa5b-d84f4857a8cd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:56.472004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d6b62-883e-4775-aa5b-d84f4857a8cd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:56.488240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f06d6b62-883e-4775-aa5b-d84f4857a8cd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:11:56.488240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:56.488240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:56.488240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:56.488240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:56.488240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:56.488240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:56.488240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:56.488240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:56.488240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:56.488240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:56.488240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:56.488240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:11:56.488240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:11:56.488240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:11:56.488240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:11:56.489290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:56.489290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:56.489290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:11:56.489290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:56.489290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:11:56.489290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:56.489290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:56.489290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:56.489290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:56.489290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:56.489290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:56.489290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:56.489290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:56.489290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:56.489290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:56.489290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:56.489290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:56.489290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:56.490243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:56.490243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:56.490243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:11:56.490243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:11:56.490243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:11:56.490243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:11:56.490243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:11:56.490243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:11:56.490243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:11:56.490243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:56.490243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 310/614] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:11:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:56.497705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981ced3-d231-4287-9141-9eacf0a2207e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:56.642289 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981ced3-d231-4287-9141-9eacf0a2207e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:56.680393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c771673-d15e-4a6f-9076-f3554605cce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:56.680978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c771673-d15e-4a6f-9076-f3554605cce3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.681250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c771673-d15e-4a6f-9076-f3554605cce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.681516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c771673-d15e-4a6f-9076-f3554605cce3 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.682239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c771673-d15e-4a6f-9076-f3554605cce3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:56.682539 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c771673-d15e-4a6f-9076-f3554605cce3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:56.684005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c771673-d15e-4a6f-9076-f3554605cce3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:56.686762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:56.707161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 305/615] 10.222.0.107 () {56 vars in 1140 bytes} [Tue Aug 23 23:11:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:56.708556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d6b62-883e-4775-aa5b-d84f4857a8cd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:56.862451 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d6b62-883e-4775-aa5b-d84f4857a8cd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:56.904670 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab4cd9-65ca-4ff4-a6f5-01743f7a959e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:56.905520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab4cd9-65ca-4ff4-a6f5-01743f7a959e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.905804 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab4cd9-65ca-4ff4-a6f5-01743f7a959e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.906078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab4cd9-65ca-4ff4-a6f5-01743f7a959e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.928424 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62967cb2-48cb-46ec-9b50-6c275ee8ed61 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.928783 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62967cb2-48cb-46ec-9b50-6c275ee8ed61 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.929028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62967cb2-48cb-46ec-9b50-6c275ee8ed61 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.930042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab4cd9-65ca-4ff4-a6f5-01743f7a959e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:56.930701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 306/616] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:11:56.931560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab4cd9-65ca-4ff4-a6f5-01743f7a959e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:56.936695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c35af8-f72d-4ba4-8b31-654afa9bfd3f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:56.936985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c35af8-f72d-4ba4-8b31-654afa9bfd3f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:56.937451 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c35af8-f72d-4ba4-8b31-654afa9bfd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:56.947562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-13ab4cd9-65ca-4ff4-a6f5-01743f7a959e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:56.947562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:56.947562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:56.947562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:56.947562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:56.947562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:56.947562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:56.947562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:56.947562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:56.947562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:56.947562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:56.947562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:56.947562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:56.947562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:56.947562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:56.947562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:56.948538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:56.948538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:56.948538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:56.948538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:56.948538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:56.948538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:56.948538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:56.948538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:56.948538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:56.948538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:56.948538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:56.948538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:56.948538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:56.948538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:56.948538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:56.948538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:56.948538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:56.949872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:56.949872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:56.949872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:56.949872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 311/617] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:56.955796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab4cd9-65ca-4ff4-a6f5-01743f7a959e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:56.963758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:56.976348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-93c35af8-f72d-4ba4-8b31-654afa9bfd3f None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:56.978074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-93c35af8-f72d-4ba4-8b31-654afa9bfd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:57.061190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 307/618] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:57.152489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab4cd9-65ca-4ff4-a6f5-01743f7a959e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:57.203726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321d5b9-ddce-47ea-bb7d-f34e2c9b5c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:57.204349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321d5b9-ddce-47ea-bb7d-f34e2c9b5c96 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:57.204644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321d5b9-ddce-47ea-bb7d-f34e2c9b5c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:57.204920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321d5b9-ddce-47ea-bb7d-f34e2c9b5c96 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:57.205571 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321d5b9-ddce-47ea-bb7d-f34e2c9b5c96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:57.205878 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321d5b9-ddce-47ea-bb7d-f34e2c9b5c96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:57.207260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321d5b9-ddce-47ea-bb7d-f34e2c9b5c96 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:57.219915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 312/619] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:57.225941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c35af8-f72d-4ba4-8b31-654afa9bfd3f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:57.389833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c35af8-f72d-4ba4-8b31-654afa9bfd3f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:57.420069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321d5b9-ddce-47ea-bb7d-f34e2c9b5c96 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:57.436911 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:57.460084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40486d5-d5ac-4673-8e3a-a3fa83c1c9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:57.460900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40486d5-d5ac-4673-8e3a-a3fa83c1c9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:57.461176 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40486d5-d5ac-4673-8e3a-a3fa83c1c9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:57.461446 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40486d5-d5ac-4673-8e3a-a3fa83c1c9c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:57.479537 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40486d5-d5ac-4673-8e3a-a3fa83c1c9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:57.481036 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40486d5-d5ac-4673-8e3a-a3fa83c1c9c0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:57.494257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b40486d5-d5ac-4673-8e3a-a3fa83c1c9c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:57.494257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:57.494257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:57.494257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:57.494257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:57.494257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:57.494257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:57.494257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:57.494257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:57.494257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:57.494257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:57.494257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:57.494257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:11:57.494257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:11:57.494257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:11:57.495401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:11:57.495401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:57.495401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:57.495401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:57.495401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:57.495401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:57.495401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:57.495401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:57.495401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:57.495401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:57.495401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:57.495401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:57.495401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:57.495401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:57.495401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:57.495401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:57.495401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:57.496892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:11:57.496892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:11:57.496892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:11:57.496892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:11:57.496892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:11:57.496892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:11:57.496892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:57.496892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:57.496892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 308/620] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:57.498055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f51df-347b-4b90-988f-84739d4fd580 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:57.498055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f51df-347b-4b90-988f-84739d4fd580 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:57.498055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f51df-347b-4b90-988f-84739d4fd580 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:57.499499 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 309/621] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:57.504626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627961f-bd95-498f-9b0b-a489aa98556a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:57.504911 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627961f-bd95-498f-9b0b-a489aa98556a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:57.505185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627961f-bd95-498f-9b0b-a489aa98556a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:57.507020 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:57.524811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8627961f-bd95-498f-9b0b-a489aa98556a None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:57.525995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8627961f-bd95-498f-9b0b-a489aa98556a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:57.560725 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321d5b9-ddce-47ea-bb7d-f34e2c9b5c96 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:57.597416 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733f907-fa94-4a06-85d0-d38363e60790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:57.598072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733f907-fa94-4a06-85d0-d38363e60790 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:57.598327 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733f907-fa94-4a06-85d0-d38363e60790 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:57.598600 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733f907-fa94-4a06-85d0-d38363e60790 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:57.604715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 310/622] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:11:57.605622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627961f-bd95-498f-9b0b-a489aa98556a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:57.609588 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733f907-fa94-4a06-85d0-d38363e60790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:57.614335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d733f907-fa94-4a06-85d0-d38363e60790 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:57.614335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:57.614335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:57.614335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:57.614335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:57.614335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:57.614335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:57.614335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:57.614335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:57.614335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:57.614335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:57.614335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:57.614335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:57.614335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:57.614335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:57.614335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:57.617249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:57.617249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:57.617249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:57.617249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:57.617249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:57.617249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:57.617249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:57.617249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:57.617249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:57.617249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:57.617249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:57.617249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:57.617249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:57.617249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:57.617249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:57.617249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:57.618284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:57.618284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:57.618284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:57.618284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:57.618284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:57.618284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:57.618284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:57.618284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:57.618284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:57.618284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:57.618284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:57.618284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:57.618284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 313/623] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:11:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:11:57.625780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733f907-fa94-4a06-85d0-d38363e60790 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:57.745913 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733f907-fa94-4a06-85d0-d38363e60790 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:57.771157 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:57.774124 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627961f-bd95-498f-9b0b-a489aa98556a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:57.793570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:57.794610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313ca0e-6201-4c64-bead-7949570be0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:57.795338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313ca0e-6201-4c64-bead-7949570be0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:57.795909 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313ca0e-6201-4c64-bead-7949570be0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:57.796189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313ca0e-6201-4c64-bead-7949570be0f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:57.797001 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313ca0e-6201-4c64-bead-7949570be0f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:57.798527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313ca0e-6201-4c64-bead-7949570be0f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:57.800236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313ca0e-6201-4c64-bead-7949570be0f7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:57.819208 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 314/624] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:57 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:57.819983 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df1e5e-59fc-4c47-b92c-6bbc2f867457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:57.820619 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df1e5e-59fc-4c47-b92c-6bbc2f867457 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:57.820954 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df1e5e-59fc-4c47-b92c-6bbc2f867457 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:57.821221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df1e5e-59fc-4c47-b92c-6bbc2f867457 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:57.821985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df1e5e-59fc-4c47-b92c-6bbc2f867457 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:57.822287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df1e5e-59fc-4c47-b92c-6bbc2f867457 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:57.823710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df1e5e-59fc-4c47-b92c-6bbc2f867457 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:57.826414 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313ca0e-6201-4c64-bead-7949570be0f7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:57.849949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 311/625] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:11:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:57.856836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df1e5e-59fc-4c47-b92c-6bbc2f867457 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:57.968350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df1e5e-59fc-4c47-b92c-6bbc2f867457 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:58.004517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f0bff-d8a0-42e0-b8bc-154c66d61226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:58.005261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f0bff-d8a0-42e0-b8bc-154c66d61226 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.005541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f0bff-d8a0-42e0-b8bc-154c66d61226 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.005810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f0bff-d8a0-42e0-b8bc-154c66d61226 None admin] PATH_INFO: `/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/35d0b95b22bc4117957cbc3afa5547a4/roles/ee7f9512e7e745199ff5ed847343d11a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.022850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f0bff-d8a0-42e0-b8bc-154c66d61226 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7cdd07c79614516be35aa2d82ec6a3b, user_id=35d0b95b22bc4117957cbc3afa5547a4, role_id=ee7f9512e7e745199ff5ed847343d11a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:58.024633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f0bff-d8a0-42e0-b8bc-154c66d61226 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:58.039989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 312/626] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:11:57 2022] PUT /identity/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/35d0b95b22bc4117957cbc3afa5547a4/roles/ee7f9512e7e745199ff5ed847343d11a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:11:58.051874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f0bff-d8a0-42e0-b8bc-154c66d61226 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:58.056180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313ca0e-6201-4c64-bead-7949570be0f7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:58.083415 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:58.094514 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324057e-5725-4bce-97d0-4d30b1ec2e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:58.095219 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324057e-5725-4bce-97d0-4d30b1ec2e06 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.095504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324057e-5725-4bce-97d0-4d30b1ec2e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.095780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324057e-5725-4bce-97d0-4d30b1ec2e06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.108858 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324057e-5725-4bce-97d0-4d30b1ec2e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:58.110351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324057e-5725-4bce-97d0-4d30b1ec2e06 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:58.126631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d324057e-5725-4bce-97d0-4d30b1ec2e06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:58.126631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:58.126631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:58.126631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:58.126631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:58.126631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:58.126631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:58.126631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:58.126631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:58.126631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:58.126631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:58.126631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:58.126631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:58.126631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:58.126631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:58.126631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:58.127633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:58.127633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:58.127633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:58.127633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:58.127633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:58.127633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:58.127633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:58.127633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:58.127633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:58.127633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:58.127633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:58.127633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:58.127633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:58.127633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:58.127633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:58.127633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:58.127633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:58.128526 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:58.128526 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:58.128526 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:58.128526 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 315/627] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:58.136577 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324057e-5725-4bce-97d0-4d30b1ec2e06 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:58.177851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f0bff-d8a0-42e0-b8bc-154c66d61226 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:58.203828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:58.270881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324057e-5725-4bce-97d0-4d30b1ec2e06 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:58.282203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a9e70-5ae8-41e9-a1a6-1cb0aed52767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:58.282863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a9e70-5ae8-41e9-a1a6-1cb0aed52767 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.283125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a9e70-5ae8-41e9-a1a6-1cb0aed52767 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.283392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a9e70-5ae8-41e9-a1a6-1cb0aed52767 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.305474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a9e70-5ae8-41e9-a1a6-1cb0aed52767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:58.309091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9e6b4-6094-4f42-80a5-7c507f6a21c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:58.309889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9e6b4-6094-4f42-80a5-7c507f6a21c5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.310346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9e6b4-6094-4f42-80a5-7c507f6a21c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.310762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9e6b4-6094-4f42-80a5-7c507f6a21c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.311558 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9e6b4-6094-4f42-80a5-7c507f6a21c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:58.312009 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9e6b4-6094-4f42-80a5-7c507f6a21c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:58.313554 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9e6b4-6094-4f42-80a5-7c507f6a21c5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:58.314413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-1a4a9e70-5ae8-41e9-a1a6-1cb0aed52767 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:58.314413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:58.314413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:58.314413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:58.314413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:58.314413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:58.314413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:58.314413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:58.314413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:58.314413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:58.314413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:58.314413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:58.314413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:58.314413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:58.314413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:58.314413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:58.315533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:58.315533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:58.315533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:58.315533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:58.315533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:58.315533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:58.315533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:58.315533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:58.315533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:58.315533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:58.315533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:58.315533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:58.315533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:58.315533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:58.315533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:58.315533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:58.316707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:58.316707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:58.316707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:58.316707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:58.316707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:58.316707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:58.316707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:58.316707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:58.316707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:58.316707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:58.316707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:58.316707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:58.316707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 313/628] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:11:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:11:58.322519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a9e70-5ae8-41e9-a1a6-1cb0aed52767 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:58.331621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 316/629] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:58.338198 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9e6b4-6094-4f42-80a5-7c507f6a21c5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:58.422531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:58.436467 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a9e70-5ae8-41e9-a1a6-1cb0aed52767 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:58.473235 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620e434-a3e6-4483-bd6c-0ccec3b8bd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:58.473843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620e434-a3e6-4483-bd6c-0ccec3b8bd5c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.474181 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620e434-a3e6-4483-bd6c-0ccec3b8bd5c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.474457 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620e434-a3e6-4483-bd6c-0ccec3b8bd5c None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.475179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620e434-a3e6-4483-bd6c-0ccec3b8bd5c None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:58.476259 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620e434-a3e6-4483-bd6c-0ccec3b8bd5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:58.478208 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620e434-a3e6-4483-bd6c-0ccec3b8bd5c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:58.487089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 314/630] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:58 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:58.488319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ca545-ac55-4dd9-ab25-a15107ace006 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.488618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ca545-ac55-4dd9-ab25-a15107ace006 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.494241 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ca545-ac55-4dd9-ab25-a15107ace006 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.495901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 315/631] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:58 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:58.500099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ca545-ac55-4dd9-ab25-a15107ace006 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:58.503235 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:58.512780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9e6b4-6094-4f42-80a5-7c507f6a21c5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:58.551360 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0703e48-c152-4a87-95c9-278fd08b3a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:58.552027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0703e48-c152-4a87-95c9-278fd08b3a92 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.552368 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0703e48-c152-4a87-95c9-278fd08b3a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.552763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0703e48-c152-4a87-95c9-278fd08b3a92 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.561063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0703e48-c152-4a87-95c9-278fd08b3a92 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:58.562519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0703e48-c152-4a87-95c9-278fd08b3a92 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:58.575505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-b0703e48-c152-4a87-95c9-278fd08b3a92 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:11:58.575505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:58.575505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:58.575505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:58.575505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:58.575505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:58.575505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:58.575505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:58.575505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:58.575505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:58.575505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:58.575505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:58.575505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:11:58.575505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:11:58.575505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:11:58.575505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:11:58.576508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:58.576508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:58.576508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:11:58.576508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:58.576508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:11:58.576508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:58.576508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:58.576508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:58.576508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:58.576508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:58.576508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:58.576508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:58.576508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:58.576508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:58.576508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:58.576508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:58.576508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:58.576508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:58.578224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:58.578224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:58.578224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:11:58.578224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:11:58.578224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:11:58.578224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:11:58.578224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:11:58.578224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:11:58.578224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:11:58.578224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:58.578224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 317/632] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:11:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:58.582329 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e44dff-d5d8-47b8-9249-5ab5623d3955 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.582618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e44dff-d5d8-47b8-9249-5ab5623d3955 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.582888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e44dff-d5d8-47b8-9249-5ab5623d3955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.602513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-45e44dff-d5d8-47b8-9249-5ab5623d3955 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:58.603702 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-45e44dff-d5d8-47b8-9249-5ab5623d3955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:58.623729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ca545-ac55-4dd9-ab25-a15107ace006 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:58.660037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e77ef9-8a0f-45df-8486-78ada24c07c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:58.660692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e77ef9-8a0f-45df-8486-78ada24c07c7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.660973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e77ef9-8a0f-45df-8486-78ada24c07c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.661256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e77ef9-8a0f-45df-8486-78ada24c07c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.673153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e77ef9-8a0f-45df-8486-78ada24c07c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:58.674603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e77ef9-8a0f-45df-8486-78ada24c07c7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:58.679599 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 318/633] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:58.680770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd080f-e1cf-4ebf-b200-f85e8488d8b1 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.681059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd080f-e1cf-4ebf-b200-f85e8488d8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.681330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd080f-e1cf-4ebf-b200-f85e8488d8b1 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.682832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 319/634] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:11:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:11:58.683545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd080f-e1cf-4ebf-b200-f85e8488d8b1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:58.684017 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:58.696708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-13e77ef9-8a0f-45df-8486-78ada24c07c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:58.696708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:58.696708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:58.696708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:58.696708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:58.696708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:58.696708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:58.696708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:58.696708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:58.696708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:58.696708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:58.696708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:58.696708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:58.696708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:58.696708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:58.696708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:58.697746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:58.697746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:58.697746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:58.697746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:58.697746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:58.697746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:58.697746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:58.697746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:58.697746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:58.697746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:58.697746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:58.697746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:58.697746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:58.697746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:58.697746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:58.697746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:58.697746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:58.698661 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:58.698661 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:58.698661 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:58.700737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 316/635] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:58.702236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca84216-e67d-4431-92bf-0c4142156995 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.702725 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca84216-e67d-4431-92bf-0c4142156995 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.703970 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca84216-e67d-4431-92bf-0c4142156995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.730308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2ca84216-e67d-4431-92bf-0c4142156995 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:58.731971 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2ca84216-e67d-4431-92bf-0c4142156995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:58.787438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:58.805674 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd080f-e1cf-4ebf-b200-f85e8488d8b1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:58.834123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 317/636] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:11:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:11:58.837744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca84216-e67d-4431-92bf-0c4142156995 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:58.851950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86cd3e-54c7-4927-9376-a9c4850ec53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:58.852674 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86cd3e-54c7-4927-9376-a9c4850ec53c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:58.853066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86cd3e-54c7-4927-9376-a9c4850ec53c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:58.853497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86cd3e-54c7-4927-9376-a9c4850ec53c None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:58.854308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86cd3e-54c7-4927-9376-a9c4850ec53c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:58.854678 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86cd3e-54c7-4927-9376-a9c4850ec53c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:58.856263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86cd3e-54c7-4927-9376-a9c4850ec53c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:58.875100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 320/637] 10.222.0.107 () {56 vars in 1142 bytes} [Tue Aug 23 23:11:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:58.882193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86cd3e-54c7-4927-9376-a9c4850ec53c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:59.014281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca84216-e67d-4431-92bf-0c4142156995 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:59.051753 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:59.062605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fd6cf-bf0d-4ad7-abd5-8ce94aa6052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:59.063298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86cd3e-54c7-4927-9376-a9c4850ec53c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:59.063735 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fd6cf-bf0d-4ad7-abd5-8ce94aa6052f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:59.064209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fd6cf-bf0d-4ad7-abd5-8ce94aa6052f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:59.064826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fd6cf-bf0d-4ad7-abd5-8ce94aa6052f None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:59.065767 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fd6cf-bf0d-4ad7-abd5-8ce94aa6052f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:59.066264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fd6cf-bf0d-4ad7-abd5-8ce94aa6052f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:59.067845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fd6cf-bf0d-4ad7-abd5-8ce94aa6052f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:59.085004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 318/638] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:59.086403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fd6cf-bf0d-4ad7-abd5-8ce94aa6052f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:59.109448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b303c-1069-4e4d-8023-ffb5c630f031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:59.110127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b303c-1069-4e4d-8023-ffb5c630f031 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:59.110410 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b303c-1069-4e4d-8023-ffb5c630f031 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:59.110680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b303c-1069-4e4d-8023-ffb5c630f031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:59.129937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:59.189589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b303c-1069-4e4d-8023-ffb5c630f031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:59.191051 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b303c-1069-4e4d-8023-ffb5c630f031 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:59.201003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fd6cf-bf0d-4ad7-abd5-8ce94aa6052f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:59.244964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507e627-d03d-439a-aacb-67df6977ed96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:59.245782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507e627-d03d-439a-aacb-67df6977ed96 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:59.246116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507e627-d03d-439a-aacb-67df6977ed96 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:59.246477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507e627-d03d-439a-aacb-67df6977ed96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:59.257809 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507e627-d03d-439a-aacb-67df6977ed96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:59.262963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b507e627-d03d-439a-aacb-67df6977ed96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:59.262963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:59.262963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:59.262963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:59.262963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:59.262963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:59.262963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:59.262963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:59.262963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:59.262963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:59.262963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:59.262963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:59.262963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:59.262963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:59.262963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:59.262963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:59.264099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:59.264099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:59.264099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:59.264099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:59.264099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:59.264099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:59.264099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:59.264099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:59.264099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:59.264099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:59.264099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:59.264099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:59.264099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:59.264099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:59.264099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:59.264099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:59.265152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:59.265152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:59.265152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:59.265152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:59.265152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:59.265152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:59.265152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:59.265152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:59.265152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:59.265152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:59.265152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:59.265152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:59.270812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 319/639] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:11:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:59.271544 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507e627-d03d-439a-aacb-67df6977ed96 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:59.314143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 321/640] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:11:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:11:59.314143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b303c-1069-4e4d-8023-ffb5c630f031 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:59.331329 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:59.359337 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:59.387350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507e627-d03d-439a-aacb-67df6977ed96 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:59.425218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec068e-f2ef-40e8-8c82-7a1d0a391efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:59.425421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b303c-1069-4e4d-8023-ffb5c630f031 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:59.425845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec068e-f2ef-40e8-8c82-7a1d0a391efb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:59.426124 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec068e-f2ef-40e8-8c82-7a1d0a391efb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:59.426394 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec068e-f2ef-40e8-8c82-7a1d0a391efb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:59.434794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec068e-f2ef-40e8-8c82-7a1d0a391efb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:59.436378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec068e-f2ef-40e8-8c82-7a1d0a391efb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:59.448295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9aec068e-f2ef-40e8-8c82-7a1d0a391efb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:11:59.448295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:59.448295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:59.448295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:59.448295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:59.448295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:59.448295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:59.448295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:59.448295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:59.448295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:59.448295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:59.448295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:59.448295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:11:59.448295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:11:59.448295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:11:59.448295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:11:59.449301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:59.449301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:59.449301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:11:59.449301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:59.449301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:11:59.449301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:59.449301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:59.449301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:59.449301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:59.449301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:59.449301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:59.449301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:59.449301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:59.449301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:59.449301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:59.449301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:59.449301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:59.449301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:59.450253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:59.450253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:59.450253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:11:59.450253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:11:59.450253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:11:59.450253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:11:59.450253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:11:59.450253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:11:59.450253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:11:59.450253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:11:59.450253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 320/641] 10.222.0.107 () {56 vars in 1098 bytes} [Tue Aug 23 23:11:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:59.451476 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec068e-f2ef-40e8-8c82-7a1d0a391efb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:59.466527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752dccc-2826-4e37-bffb-90c669ba2983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:59.467163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752dccc-2826-4e37-bffb-90c669ba2983 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:59.467441 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752dccc-2826-4e37-bffb-90c669ba2983 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:59.467715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752dccc-2826-4e37-bffb-90c669ba2983 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:59.479697 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752dccc-2826-4e37-bffb-90c669ba2983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:59.484585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-9752dccc-2826-4e37-bffb-90c669ba2983 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:59.484585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:59.484585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:59.484585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:59.484585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:59.484585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:59.484585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:59.484585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:59.484585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:59.484585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:59.484585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:59.484585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:59.484585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:59.484585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:59.484585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:59.484585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:59.485712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:59.485712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:59.485712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:59.485712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:59.485712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:59.485712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:59.485712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:59.485712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:59.485712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:59.485712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:59.485712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:59.485712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:59.485712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:59.485712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:59.485712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:59.485712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:59.486562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:59.486562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:59.486562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:59.486562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:59.486562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:59.486562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:59.486562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:59.486562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:59.486562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:59.486562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:59.486562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:59.486562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:59.486562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 322/642] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:11:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:59.486562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752dccc-2826-4e37-bffb-90c669ba2983 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:59.563916 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec068e-f2ef-40e8-8c82-7a1d0a391efb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:59.575466 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:59.603286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf62a8f-3b19-44fa-9823-cba6f304d55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:59.603891 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf62a8f-3b19-44fa-9823-cba6f304d55c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:59.604165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf62a8f-3b19-44fa-9823-cba6f304d55c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:59.604431 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf62a8f-3b19-44fa-9823-cba6f304d55c None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:59.605145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf62a8f-3b19-44fa-9823-cba6f304d55c None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:59.605628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf62a8f-3b19-44fa-9823-cba6f304d55c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:59.606113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752dccc-2826-4e37-bffb-90c669ba2983 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:59.607010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf62a8f-3b19-44fa-9823-cba6f304d55c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:59.610391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:59.616318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 321/643] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:59 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:59.617199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf62a8f-3b19-44fa-9823-cba6f304d55c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:59.653259 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be880301-8468-4410-8c01-e22af2a97926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:59.654446 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be880301-8468-4410-8c01-e22af2a97926 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:59.654795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be880301-8468-4410-8c01-e22af2a97926 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:59.655075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be880301-8468-4410-8c01-e22af2a97926 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:59.666732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be880301-8468-4410-8c01-e22af2a97926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:59.668445 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be880301-8468-4410-8c01-e22af2a97926 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:59.684318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-be880301-8468-4410-8c01-e22af2a97926 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:59.684318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:59.684318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:59.684318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:59.684318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:59.684318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:59.684318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:59.684318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:59.684318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:59.684318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:59.684318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:59.684318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:59.684318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:59.684318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:59.684318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:59.684318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:59.685393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:59.685393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:59.685393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:59.685393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:59.685393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:59.685393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:59.685393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:59.685393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:59.685393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:59.685393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:59.685393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:59.685393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:59.685393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:59.685393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:59.685393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:59.685393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:59.685393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:59.686670 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:59.686670 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:59.686670 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:11:59.690147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 323/644] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:59.690762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be880301-8468-4410-8c01-e22af2a97926 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:59.749385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf62a8f-3b19-44fa-9823-cba6f304d55c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:59.792642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0984a-00b1-43c7-ae7c-659a5d065cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:59.793491 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0984a-00b1-43c7-ae7c-659a5d065cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:59.793773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0984a-00b1-43c7-ae7c-659a5d065cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:59.794050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0984a-00b1-43c7-ae7c-659a5d065cd9 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:59.794782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0984a-00b1-43c7-ae7c-659a5d065cd9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:59.795087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0984a-00b1-43c7-ae7c-659a5d065cd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:59.796520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0984a-00b1-43c7-ae7c-659a5d065cd9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:59.807094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be880301-8468-4410-8c01-e22af2a97926 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:59.822007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 322/645] 10.222.0.107 () {56 vars in 1138 bytes} [Tue Aug 23 23:11:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:59.822007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0984a-00b1-43c7-ae7c-659a5d065cd9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:59.849053 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42025299-b0ad-4444-aeb3-5dcd7e3d7cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:59.849578 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42025299-b0ad-4444-aeb3-5dcd7e3d7cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:59.849969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42025299-b0ad-4444-aeb3-5dcd7e3d7cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:59.850795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42025299-b0ad-4444-aeb3-5dcd7e3d7cc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:59.851457 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42025299-b0ad-4444-aeb3-5dcd7e3d7cc3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:59.851865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:59.852706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42025299-b0ad-4444-aeb3-5dcd7e3d7cc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:59.854150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42025299-b0ad-4444-aeb3-5dcd7e3d7cc3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:59.869458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 324/646] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:59 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:59.869458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42025299-b0ad-4444-aeb3-5dcd7e3d7cc3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:59.891421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:59.930853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0984a-00b1-43c7-ae7c-659a5d065cd9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:59.968748 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62db785-68c1-457e-b448-9345ffb84878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:59.969384 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62db785-68c1-457e-b448-9345ffb84878 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:59.969661 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62db785-68c1-457e-b448-9345ffb84878 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:59.969932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62db785-68c1-457e-b448-9345ffb84878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:59.981317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62db785-68c1-457e-b448-9345ffb84878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:59.982788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62db785-68c1-457e-b448-9345ffb84878 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:59.989245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42025299-b0ad-4444-aeb3-5dcd7e3d7cc3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:59.998655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c62db785-68c1-457e-b448-9345ffb84878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:59.998655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:59.998655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:59.998655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:59.998655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:59.998655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:59.998655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:59.998655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:59.998655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:59.998655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:59.998655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:59.998655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:59.998655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:59.998655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:59.998655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:59.998655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:59.999790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:59.999790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:59.999790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:59.999790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:59.999790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:59.999790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:59.999790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:59.999790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:59.999790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:59.999790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:59.999790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:59.999790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:59.999790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:59.999790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:59.999790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:59.999790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:59.999790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:00.000934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:00.000934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:00.000934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:00.000934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 323/647] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:00.000934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62db785-68c1-457e-b448-9345ffb84878 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:00.042018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2bb2b-26d1-42d9-a0b1-a93befa9696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:00.043525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2bb2b-26d1-42d9-a0b1-a93befa9696d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:00.043818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2bb2b-26d1-42d9-a0b1-a93befa9696d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:00.044095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2bb2b-26d1-42d9-a0b1-a93befa9696d None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:00.044784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2bb2b-26d1-42d9-a0b1-a93befa9696d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:00.045092 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2bb2b-26d1-42d9-a0b1-a93befa9696d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:00.047445 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2bb2b-26d1-42d9-a0b1-a93befa9696d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:00.068242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 325/648] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:11:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:00.068242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2bb2b-26d1-42d9-a0b1-a93befa9696d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:00.095099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:00.115258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62db785-68c1-457e-b448-9345ffb84878 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:00.150445 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a8ca3-f0d5-4e8c-8d31-540d2e601abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:00.151036 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a8ca3-f0d5-4e8c-8d31-540d2e601abf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:00.151308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a8ca3-f0d5-4e8c-8d31-540d2e601abf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:00.151572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a8ca3-f0d5-4e8c-8d31-540d2e601abf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:00.154679 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:00.176059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2bb2b-26d1-42d9-a0b1-a93befa9696d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:00.210233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddd513-df96-42b1-b033-86a4f0c6821a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:00.210952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddd513-df96-42b1-b033-86a4f0c6821a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:00.211229 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddd513-df96-42b1-b033-86a4f0c6821a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:00.211499 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddd513-df96-42b1-b033-86a4f0c6821a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:00.219958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a8ca3-f0d5-4e8c-8d31-540d2e601abf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:00.221139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a8ca3-f0d5-4e8c-8d31-540d2e601abf None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:00.222008 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddd513-df96-42b1-b033-86a4f0c6821a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:00.223429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddd513-df96-42b1-b033-86a4f0c6821a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:00.238007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a4ddd513-df96-42b1-b033-86a4f0c6821a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:00.238007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:00.238007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:00.238007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:00.238007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:00.238007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:00.238007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:00.238007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:00.238007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:00.238007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:00.238007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:00.238007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:00.238007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:00.238007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:00.238007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:00.238007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:00.239143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:00.239143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:00.239143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:00.239143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:00.239143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:00.239143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:00.239143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:00.239143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:00.239143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:00.239143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:00.239143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:00.239143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:00.239143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:00.239143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:00.239143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:00.239143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:00.239143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:00.240050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:00.240050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:00.240050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:00.240050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 326/649] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:00.240282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddd513-df96-42b1-b033-86a4f0c6821a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:00.306681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:00.326645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 324/650] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:12:00 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:00.327480 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a8ca3-f0d5-4e8c-8d31-540d2e601abf None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:00.341615 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddd513-df96-42b1-b033-86a4f0c6821a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:00.370835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:00.376936 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04849714-032f-4de9-a051-a89a4e766d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:00.377537 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04849714-032f-4de9-a051-a89a4e766d90 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:00.377811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04849714-032f-4de9-a051-a89a4e766d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:00.378078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04849714-032f-4de9-a051-a89a4e766d90 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:00.378713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04849714-032f-4de9-a051-a89a4e766d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:00.379012 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04849714-032f-4de9-a051-a89a4e766d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:00.380398 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04849714-032f-4de9-a051-a89a4e766d90 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:00.392257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 327/651] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:00.393355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca34ae0-bc74-4d12-a91f-765abe799a2e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:00.393634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca34ae0-bc74-4d12-a91f-765abe799a2e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:00.393903 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca34ae0-bc74-4d12-a91f-765abe799a2e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:00.398978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 328/652] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:00.398978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca34ae0-bc74-4d12-a91f-765abe799a2e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:00.431399 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a8ca3-f0d5-4e8c-8d31-540d2e601abf None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:00.466244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92badd1-73e3-4994-b4a2-7ca6a2dd84f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:00.466865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92badd1-73e3-4994-b4a2-7ca6a2dd84f8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:00.467134 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92badd1-73e3-4994-b4a2-7ca6a2dd84f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:00.467400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92badd1-73e3-4994-b4a2-7ca6a2dd84f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:00.474634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92badd1-73e3-4994-b4a2-7ca6a2dd84f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:00.476565 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92badd1-73e3-4994-b4a2-7ca6a2dd84f8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:00.487784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f92badd1-73e3-4994-b4a2-7ca6a2dd84f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:00.487784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:00.487784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:00.487784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:00.487784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:00.487784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:00.487784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:00.487784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:00.487784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:00.487784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:00.487784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:00.487784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:00.487784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:00.487784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:00.487784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:00.488872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:00.488872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:00.488872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:00.488872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:00.488872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:00.488872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:00.488872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:00.488872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:00.488872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:00.488872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:00.488872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:00.488872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:00.488872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:00.488872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:00.488872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:00.488872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:00.488872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:00.490170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:00.490170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:00.490170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:00.490170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:00.490170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:00.490170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:00.490170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:00.490170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:00.490170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 325/653] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:00.490170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92badd1-73e3-4994-b4a2-7ca6a2dd84f8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:00.504258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca34ae0-bc74-4d12-a91f-765abe799a2e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:00.534382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:00.539512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd56bd4-5d44-42c8-bac6-401e908883c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:00.540123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd56bd4-5d44-42c8-bac6-401e908883c4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:00.540403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd56bd4-5d44-42c8-bac6-401e908883c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:00.540700 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd56bd4-5d44-42c8-bac6-401e908883c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:00.541339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd56bd4-5d44-42c8-bac6-401e908883c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:00.541639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd56bd4-5d44-42c8-bac6-401e908883c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:00.543292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd56bd4-5d44-42c8-bac6-401e908883c4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:00.554654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 329/654] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:00.555520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd56bd4-5d44-42c8-bac6-401e908883c4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:00.594223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92badd1-73e3-4994-b4a2-7ca6a2dd84f8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:00.606934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:00.628719 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fa533-6212-476f-b7a6-b53f7c864363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:00.629251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fa533-6212-476f-b7a6-b53f7c864363 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:00.629524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fa533-6212-476f-b7a6-b53f7c864363 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:00.629794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fa533-6212-476f-b7a6-b53f7c864363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:00.640912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fa533-6212-476f-b7a6-b53f7c864363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:00.642357 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fa533-6212-476f-b7a6-b53f7c864363 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:00.656759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-804fa533-6212-476f-b7a6-b53f7c864363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:00.656759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:00.656759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:00.656759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:00.656759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:00.656759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:00.656759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:00.656759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:00.656759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:00.656759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:00.656759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:00.656759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:00.656759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:00.656759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:00.656759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:00.656759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:00.657910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:00.657910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:00.657910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:00.657910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:00.657910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:00.657910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:00.657910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:00.657910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:00.657910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:00.657910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:00.657910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:00.657910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:00.657910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:00.657910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:00.657910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:00.657910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:00.657910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:00.658966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:00.658966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:00.658966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:00.658966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 326/655] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:00.659414 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069037b3-3eff-482e-a17b-61a6caffa859 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:00.659692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069037b3-3eff-482e-a17b-61a6caffa859 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:00.659958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069037b3-3eff-482e-a17b-61a6caffa859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:00.665028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd56bd4-5d44-42c8-bac6-401e908883c4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:00.677615 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-069037b3-3eff-482e-a17b-61a6caffa859 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:00.679325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-069037b3-3eff-482e-a17b-61a6caffa859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:00.701094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2b1f5-5bf5-4cbc-885f-fef7fe49dc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:00.701725 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2b1f5-5bf5-4cbc-885f-fef7fe49dc93 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:00.702003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2b1f5-5bf5-4cbc-885f-fef7fe49dc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:00.702274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2b1f5-5bf5-4cbc-885f-fef7fe49dc93 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:00.710226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2b1f5-5bf5-4cbc-885f-fef7fe49dc93 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:00.711669 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2b1f5-5bf5-4cbc-885f-fef7fe49dc93 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:00.722705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-46b2b1f5-5bf5-4cbc-885f-fef7fe49dc93 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:12:00.722705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:00.722705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:00.722705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:00.722705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:00.722705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:00.722705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:00.722705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:00.722705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:00.722705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:00.722705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:00.722705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:00.722705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:00.722705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:00.722705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:00.722705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:00.723823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:00.723823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:00.723823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:00.723823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:00.723823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:00.723823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:00.723823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:00.723823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:00.723823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:00.723823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:00.723823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:00.723823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:00.723823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:00.723823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:00.723823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:00.723823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:00.723823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:00.723823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:00.724805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:00.724805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:00.724805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:00.724805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:00.724805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:00.724805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:00.724805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:00.724805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:00.724805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:12:00.724805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:00.724805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 330/656] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:12:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:00.724805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2b1f5-5bf5-4cbc-885f-fef7fe49dc93 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:00.752808 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 327/657] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:00.753653 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069037b3-3eff-482e-a17b-61a6caffa859 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:00.779377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:00.833901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2b1f5-5bf5-4cbc-885f-fef7fe49dc93 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:00.844542 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:00.860236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069037b3-3eff-482e-a17b-61a6caffa859 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:00.873447 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266d214-bfb2-4b45-bd7d-584a0b62670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:00.874060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266d214-bfb2-4b45-bd7d-584a0b62670c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:00.874340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266d214-bfb2-4b45-bd7d-584a0b62670c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:00.874610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266d214-bfb2-4b45-bd7d-584a0b62670c None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:00.875301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266d214-bfb2-4b45-bd7d-584a0b62670c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:00.875603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266d214-bfb2-4b45-bd7d-584a0b62670c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:00.877055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266d214-bfb2-4b45-bd7d-584a0b62670c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:00.894527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 331/658] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:00.894527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266d214-bfb2-4b45-bd7d-584a0b62670c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:00.903360 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c853-9852-4092-b52d-5c78c27a6bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:00.903998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c853-9852-4092-b52d-5c78c27a6bde None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:00.904282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c853-9852-4092-b52d-5c78c27a6bde None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:00.904545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c853-9852-4092-b52d-5c78c27a6bde None admin] PATH_INFO: `/v3/users/glance` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:00.911901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00c853-9852-4092-b52d-5c78c27a6bde None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:00.913459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00c853-9852-4092-b52d-5c78c27a6bde None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:00.925419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-dd00c853-9852-4092-b52d-5c78c27a6bde None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:12:00.925419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:00.925419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:00.925419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:00.925419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:00.925419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:00.925419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:00.925419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:00.925419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:00.925419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:00.925419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:00.925419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:00.925419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:00.925419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:00.925419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:00.925419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:00.926563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:00.926563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:00.926563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:00.926563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:00.926563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:00.926563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:00.926563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:00.926563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:00.926563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:00.926563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:00.926563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:00.926563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:00.926563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:00.926563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:00.926563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:00.926563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:00.926563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:00.926563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:00.927533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:00.927533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:00.927533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:00.927533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:00.927533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:00.927533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:00.927533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:00.927533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:00.927533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:12:00.927533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:00.927533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 328/659] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:12:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:00.927533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c853-9852-4092-b52d-5c78c27a6bde None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:01.014960 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266d214-bfb2-4b45-bd7d-584a0b62670c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:01.030045 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:01.049099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c853-9852-4092-b52d-5c78c27a6bde None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:01.051193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07789c-4d21-4b51-b85e-bddf22c71851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:01.051793 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07789c-4d21-4b51-b85e-bddf22c71851 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:01.052067 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07789c-4d21-4b51-b85e-bddf22c71851 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:01.052334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07789c-4d21-4b51-b85e-bddf22c71851 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:01.053003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07789c-4d21-4b51-b85e-bddf22c71851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:01.053491 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07789c-4d21-4b51-b85e-bddf22c71851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:01.055582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07789c-4d21-4b51-b85e-bddf22c71851 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:01.069613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 332/660] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:01.070801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07789c-4d21-4b51-b85e-bddf22c71851 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:01.085050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46b15d-e900-41f9-898a-166decada5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:01.085744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46b15d-e900-41f9-898a-166decada5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:01.086025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46b15d-e900-41f9-898a-166decada5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:01.086303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46b15d-e900-41f9-898a-166decada5b9 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:01.087032 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46b15d-e900-41f9-898a-166decada5b9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:01.087337 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46b15d-e900-41f9-898a-166decada5b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:01.088784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46b15d-e900-41f9-898a-166decada5b9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:01.102002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:01.106473 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 329/661] 10.222.0.107 () {56 vars in 1144 bytes} [Tue Aug 23 23:12:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:01.107296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46b15d-e900-41f9-898a-166decada5b9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:01.177383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07789c-4d21-4b51-b85e-bddf22c71851 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:01.209128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46b15d-e900-41f9-898a-166decada5b9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:01.211231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dba6c-7ca6-4348-9860-59e2b20f93fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:01.211846 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dba6c-7ca6-4348-9860-59e2b20f93fb None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:01.212119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dba6c-7ca6-4348-9860-59e2b20f93fb None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:01.212391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dba6c-7ca6-4348-9860-59e2b20f93fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:01.213148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dba6c-7ca6-4348-9860-59e2b20f93fb None admin] RBAC: Adding query filter params (role.id=ee7f9512e7e745199ff5ed847343d11a, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=8937ae9f5c7840a2a5af5f851d02ea77) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:01.213458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dba6c-7ca6-4348-9860-59e2b20f93fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:01.214890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dba6c-7ca6-4348-9860-59e2b20f93fb None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:01.220729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 333/662] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:12:01 2022] GET /identity/v3/role_assignments?user.id=8937ae9f5c7840a2a5af5f851d02ea77&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=ee7f9512e7e745199ff5ed847343d11a => generated 610 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:01.221523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dba6c-7ca6-4348-9860-59e2b20f93fb None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:01.261672 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f345f-353a-495c-9f17-38db4a3a4526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:01.262299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f345f-353a-495c-9f17-38db4a3a4526 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:01.262579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f345f-353a-495c-9f17-38db4a3a4526 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:01.262855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f345f-353a-495c-9f17-38db4a3a4526 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:01.263592 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f345f-353a-495c-9f17-38db4a3a4526 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:01.263902 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f345f-353a-495c-9f17-38db4a3a4526 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:01.265417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f345f-353a-495c-9f17-38db4a3a4526 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:01.277612 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:01.287639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 330/663] 10.222.0.107 () {56 vars in 1142 bytes} [Tue Aug 23 23:12:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:01.288912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f345f-353a-495c-9f17-38db4a3a4526 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:01.346736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:01.356886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dba6c-7ca6-4348-9860-59e2b20f93fb None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:01.402288 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f58702-7572-4164-9377-874ca6fb6a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:01.402932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f58702-7572-4164-9377-874ca6fb6a3a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:01.403211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f58702-7572-4164-9377-874ca6fb6a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:01.403482 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f58702-7572-4164-9377-874ca6fb6a3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:01.414972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f58702-7572-4164-9377-874ca6fb6a3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:01.418791 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f345f-353a-495c-9f17-38db4a3a4526 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:01.420694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-39f58702-7572-4164-9377-874ca6fb6a3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:01.420694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:01.420694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:01.420694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:01.420694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:01.420694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:01.420694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:01.420694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:01.420694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:01.420694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:01.420694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:01.420694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:01.420694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:01.420694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:01.420694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:01.420694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:01.421703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:01.421703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:01.421703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:01.421703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:01.421703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:01.421703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:01.421703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:01.421703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:01.421703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:01.421703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:01.421703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:01.421703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:01.421703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:01.421703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:01.421703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:01.421703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:01.422572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:01.422572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:01.422572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:01.422572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:01.422572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:01.422572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:01.422572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:01.422572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:01.422572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:01.422572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:01.422572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:01.422572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:01.423218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 334/664] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:12:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:01.423454 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f58702-7572-4164-9377-874ca6fb6a3a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:01.459441 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be06477-c18a-458c-ae85-2e7a51d04d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:01.460883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be06477-c18a-458c-ae85-2e7a51d04d52 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:01.461215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be06477-c18a-458c-ae85-2e7a51d04d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:01.461370 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be06477-c18a-458c-ae85-2e7a51d04d52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:01.469244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be06477-c18a-458c-ae85-2e7a51d04d52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:01.470837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be06477-c18a-458c-ae85-2e7a51d04d52 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:01.484328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9be06477-c18a-458c-ae85-2e7a51d04d52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:01.484328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:01.484328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:01.484328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:01.484328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:01.484328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:01.484328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:01.484328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:01.484328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:01.484328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:01.484328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:01.484328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:01.484328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:01.484328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:01.484328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:01.485365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:01.485365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:01.485365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:01.485365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:01.485365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:01.485365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:01.485365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:01.485365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:01.485365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:01.485365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:01.485365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:01.485365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:01.485365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:01.485365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:01.485365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:01.485365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:01.485365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:01.486269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:01.486269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:01.486269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:01.486269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:01.486269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:01.486269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:01.486269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:01.486269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:01.486269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 331/665] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:01.486269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be06477-c18a-458c-ae85-2e7a51d04d52 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:01.542367 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f58702-7572-4164-9377-874ca6fb6a3a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:01.551802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:01.580249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30347fd-48ba-4bdf-9a46-f9a290ce990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:01.580901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30347fd-48ba-4bdf-9a46-f9a290ce990a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:01.581320 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30347fd-48ba-4bdf-9a46-f9a290ce990a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:01.581656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30347fd-48ba-4bdf-9a46-f9a290ce990a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:01.596354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be06477-c18a-458c-ae85-2e7a51d04d52 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:01.610419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:01.635377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f626e61-a4ff-4b23-b0ac-26d62bbd1dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:01.636076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f626e61-a4ff-4b23-b0ac-26d62bbd1dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:01.636434 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f626e61-a4ff-4b23-b0ac-26d62bbd1dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:01.636749 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f626e61-a4ff-4b23-b0ac-26d62bbd1dd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:01.678610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30347fd-48ba-4bdf-9a46-f9a290ce990a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:01.680055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30347fd-48ba-4bdf-9a46-f9a290ce990a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:01.734938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f626e61-a4ff-4b23-b0ac-26d62bbd1dd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:01.736318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f626e61-a4ff-4b23-b0ac-26d62bbd1dd6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:01.800110 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 335/666] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:12:01 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:01.800992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30347fd-48ba-4bdf-9a46-f9a290ce990a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:01.807972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:01.857679 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:01.869916 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 332/667] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:12:01 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:01.869916 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f626e61-a4ff-4b23-b0ac-26d62bbd1dd6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:01.908730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30347fd-48ba-4bdf-9a46-f9a290ce990a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:01.947189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77cc17-bde6-47c5-8392-76309eff64f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:01.947798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77cc17-bde6-47c5-8392-76309eff64f4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:01.948076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77cc17-bde6-47c5-8392-76309eff64f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:01.948342 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77cc17-bde6-47c5-8392-76309eff64f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:01.949031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77cc17-bde6-47c5-8392-76309eff64f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:01.949336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77cc17-bde6-47c5-8392-76309eff64f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:01.950708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77cc17-bde6-47c5-8392-76309eff64f4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:01.958953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 336/668] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:01 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:01.959931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77cc17-bde6-47c5-8392-76309eff64f4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:01.994818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f626e61-a4ff-4b23-b0ac-26d62bbd1dd6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:02.031631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bba61b-003d-4dd5-bf43-490f6a375301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:02.032559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bba61b-003d-4dd5-bf43-490f6a375301 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:02.032944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bba61b-003d-4dd5-bf43-490f6a375301 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:02.033215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bba61b-003d-4dd5-bf43-490f6a375301 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:02.034134 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bba61b-003d-4dd5-bf43-490f6a375301 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:02.034442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bba61b-003d-4dd5-bf43-490f6a375301 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:02.035917 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bba61b-003d-4dd5-bf43-490f6a375301 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:02.053196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 333/669] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:02.053196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bba61b-003d-4dd5-bf43-490f6a375301 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:02.073551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:02.083336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77cc17-bde6-47c5-8392-76309eff64f4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:02.102291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:02.123324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5237e9a-4cad-40e0-bc6d-92c430bba8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:02.123962 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5237e9a-4cad-40e0-bc6d-92c430bba8e6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:02.124245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5237e9a-4cad-40e0-bc6d-92c430bba8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:02.124531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5237e9a-4cad-40e0-bc6d-92c430bba8e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:02.136132 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5237e9a-4cad-40e0-bc6d-92c430bba8e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:02.137620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5237e9a-4cad-40e0-bc6d-92c430bba8e6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:02.153264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f5237e9a-4cad-40e0-bc6d-92c430bba8e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:02.153264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:02.153264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:02.153264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:02.153264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:02.153264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:02.153264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:02.153264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:02.153264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:02.153264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:02.153264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:02.153264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:02.153264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:02.153264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:02.153264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:02.153264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:02.154254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:02.154254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:02.154254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:02.154254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:02.154254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:02.154254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:02.154254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:02.154254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:02.154254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:02.154254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:02.154254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:02.154254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:02.154254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:02.154254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:02.154254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:02.154254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:02.154254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:02.155163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:02.155163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:02.155163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:02.155163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 337/670] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:02.155163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5237e9a-4cad-40e0-bc6d-92c430bba8e6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:02.169458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bba61b-003d-4dd5-bf43-490f6a375301 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:02.205723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcfbbd-647f-4839-a09c-be9d7a1eae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:02.206382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcfbbd-647f-4839-a09c-be9d7a1eae93 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:02.206662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcfbbd-647f-4839-a09c-be9d7a1eae93 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:02.206937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcfbbd-647f-4839-a09c-be9d7a1eae93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:02.217578 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcfbbd-647f-4839-a09c-be9d7a1eae93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:02.219038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcfbbd-647f-4839-a09c-be9d7a1eae93 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:02.233401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-fdbcfbbd-647f-4839-a09c-be9d7a1eae93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:02.233401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:02.233401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:02.233401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:02.233401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:02.233401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:02.233401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:02.233401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:02.233401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:02.233401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:02.233401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:02.233401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:02.233401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:02.233401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:02.233401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:02.233401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:02.234405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:02.234405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:02.234405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:02.234405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:02.234405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:02.234405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:02.234405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:02.234405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:02.234405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:02.234405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:02.234405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:02.234405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:02.234405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:02.234405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:02.234405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:02.234405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:02.234405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:02.235299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:02.235299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:02.235299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:02.235299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 334/671] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:02.235299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcfbbd-647f-4839-a09c-be9d7a1eae93 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:02.273601 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5237e9a-4cad-40e0-bc6d-92c430bba8e6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:02.311390 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe28e90-7f06-4ff6-a907-9e3e44798ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:02.312609 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe28e90-7f06-4ff6-a907-9e3e44798ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:02.312912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe28e90-7f06-4ff6-a907-9e3e44798ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:02.313173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe28e90-7f06-4ff6-a907-9e3e44798ba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:02.320010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:02.326270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe28e90-7f06-4ff6-a907-9e3e44798ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:02.327771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe28e90-7f06-4ff6-a907-9e3e44798ba0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:02.342841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-cfe28e90-7f06-4ff6-a907-9e3e44798ba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:02.342841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:02.342841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:02.342841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:02.342841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:02.342841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:02.342841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:02.342841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:02.342841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:02.342841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:02.342841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:02.342841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:02.342841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:02.342841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:02.342841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:02.342841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:02.344018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:02.344018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:02.344018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:02.344018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:02.344018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:02.344018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:02.344018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:02.344018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:02.344018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:02.344018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:02.344018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:02.344018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:02.344018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:02.344018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:02.344018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:02.344018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:02.344018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:02.345511 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:02.345511 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:02.345511 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:02.345511 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 338/672] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:02.345511 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe28e90-7f06-4ff6-a907-9e3e44798ba0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:02.358804 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcfbbd-647f-4839-a09c-be9d7a1eae93 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:02.369997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:02.398615 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db86f6-e0ba-4527-862b-bd901e947104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:02.399216 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db86f6-e0ba-4527-862b-bd901e947104 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:02.399496 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db86f6-e0ba-4527-862b-bd901e947104 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:02.399764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db86f6-e0ba-4527-862b-bd901e947104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:02.400483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db86f6-e0ba-4527-862b-bd901e947104 None admin] RBAC: Adding query filter params (role.id=ee7f9512e7e745199ff5ed847343d11a, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=2f985626d8af4f3089e72998fad98b47) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:02.400824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db86f6-e0ba-4527-862b-bd901e947104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:02.402252 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db86f6-e0ba-4527-862b-bd901e947104 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:02.416625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 335/673] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:12:02 2022] GET /identity/v3/role_assignments?user.id=2f985626d8af4f3089e72998fad98b47&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=ee7f9512e7e745199ff5ed847343d11a => generated 610 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:02.416625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db86f6-e0ba-4527-862b-bd901e947104 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:02.499490 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe28e90-7f06-4ff6-a907-9e3e44798ba0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:02.537045 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db86f6-e0ba-4527-862b-bd901e947104 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:02.553446 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d6cb1-1993-4b81-ab25-d3230e8d2af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:02.555520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d6cb1-1993-4b81-ab25-d3230e8d2af6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:02.555520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d6cb1-1993-4b81-ab25-d3230e8d2af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:02.555520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d6cb1-1993-4b81-ab25-d3230e8d2af6 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:02.556071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d6cb1-1993-4b81-ab25-d3230e8d2af6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:02.556380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d6cb1-1993-4b81-ab25-d3230e8d2af6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:02.558099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d6cb1-1993-4b81-ab25-d3230e8d2af6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:02.576766 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 339/674] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:02.576766 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d6cb1-1993-4b81-ab25-d3230e8d2af6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:02.589871 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51825153-adf7-434d-a534-c162b29ca504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:02.590597 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51825153-adf7-434d-a534-c162b29ca504 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:02.590780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51825153-adf7-434d-a534-c162b29ca504 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:02.591016 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51825153-adf7-434d-a534-c162b29ca504 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:02.591659 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51825153-adf7-434d-a534-c162b29ca504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:02.592039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51825153-adf7-434d-a534-c162b29ca504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:02.593455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51825153-adf7-434d-a534-c162b29ca504 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:02.595098 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:02.607604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 336/675] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:02.608232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51825153-adf7-434d-a534-c162b29ca504 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:02.686874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:02.714682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d6cb1-1993-4b81-ab25-d3230e8d2af6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:02.742594 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51825153-adf7-434d-a534-c162b29ca504 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:02.762544 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44319184-9489-48cc-8e11-0abefb93f930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:02.763431 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44319184-9489-48cc-8e11-0abefb93f930 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:02.763713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44319184-9489-48cc-8e11-0abefb93f930 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:02.763986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44319184-9489-48cc-8e11-0abefb93f930 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:02.764657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44319184-9489-48cc-8e11-0abefb93f930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:02.764965 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44319184-9489-48cc-8e11-0abefb93f930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:02.766992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44319184-9489-48cc-8e11-0abefb93f930 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:02.783629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 340/676] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:02.784478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44319184-9489-48cc-8e11-0abefb93f930 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:02.786527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b5e00-88e1-41a7-a6ea-cf4de6ce988d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:02.787511 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b5e00-88e1-41a7-a6ea-cf4de6ce988d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:02.788554 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b5e00-88e1-41a7-a6ea-cf4de6ce988d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:02.789177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b5e00-88e1-41a7-a6ea-cf4de6ce988d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:02.797542 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b5e00-88e1-41a7-a6ea-cf4de6ce988d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:02.799328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b5e00-88e1-41a7-a6ea-cf4de6ce988d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:02.813018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-857b5e00-88e1-41a7-a6ea-cf4de6ce988d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:02.813018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:02.813018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:02.813018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:02.813018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:02.813018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:02.813018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:02.813018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:02.813018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:02.813018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:02.813018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:02.813018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:02.813018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:02.813018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:02.813018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:02.813976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:02.813976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:02.813976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:02.813976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:02.813976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:02.813976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:02.813976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:02.813976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:02.813976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:02.813976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:02.813976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:02.813976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:02.813976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:02.813976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:02.813976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:02.813976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:02.813976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:02.814898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:02.814898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:02.814898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:02.814898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:02.814898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:02.814898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:02.814898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:02.814898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:02.822219 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 337/677] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:02.823516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b5e00-88e1-41a7-a6ea-cf4de6ce988d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:02.888776 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:02.926054 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44319184-9489-48cc-8e11-0abefb93f930 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:02.943337 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b5e00-88e1-41a7-a6ea-cf4de6ce988d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:02.971848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c56d2a-ea43-4333-9f82-e3581da4a1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:02.972493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c56d2a-ea43-4333-9f82-e3581da4a1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:02.972860 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c56d2a-ea43-4333-9f82-e3581da4a1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:02.973109 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c56d2a-ea43-4333-9f82-e3581da4a1c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:02.982694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c56d2a-ea43-4333-9f82-e3581da4a1c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:02.984180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c56d2a-ea43-4333-9f82-e3581da4a1c9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:02.984714 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53853a9b-439f-44c0-8be6-2daf6087624d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:02.985685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53853a9b-439f-44c0-8be6-2daf6087624d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:02.986274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53853a9b-439f-44c0-8be6-2daf6087624d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:02.986751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53853a9b-439f-44c0-8be6-2daf6087624d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:02.987181 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:03.001780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53853a9b-439f-44c0-8be6-2daf6087624d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:03.003266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53853a9b-439f-44c0-8be6-2daf6087624d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:03.003757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-15c56d2a-ea43-4333-9f82-e3581da4a1c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:03.003757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:03.003757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:03.003757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:03.003757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:03.003757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:03.003757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:03.003757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:03.003757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:03.003757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:03.003757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:03.003757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:03.003757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:03.003757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:03.003757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:03.004833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:03.004833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:03.004833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:03.004833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:03.004833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:03.004833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:03.004833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:03.004833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:03.004833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:03.004833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:03.004833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:03.004833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:03.004833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:03.004833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:03.004833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:03.004833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:03.004833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:03.005969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:03.005969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:03.005969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:03.005969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:03.005969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:03.005969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:03.005969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:03.005969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:03.008429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 341/678] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:03.009618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c56d2a-ea43-4333-9f82-e3581da4a1c9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:03.020061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-53853a9b-439f-44c0-8be6-2daf6087624d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:12:03.020061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:03.020061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:03.020061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:03.020061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:03.020061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:03.020061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:03.020061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:03.020061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:03.020061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:03.020061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:03.020061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:03.020061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:03.020061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:03.020061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:03.020061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:03.022977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:03.022977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:03.022977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:03.022977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:03.022977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:03.022977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:03.022977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:03.022977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:03.022977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:03.022977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:03.022977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:03.022977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:03.022977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:03.022977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:03.022977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:03.022977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:03.022977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:03.022977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:03.024751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:03.024751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:03.024751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:03.024751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:03.024751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:03.024751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:03.024751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:03.024751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:03.024751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:12:03.024751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:03.028101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 338/679] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:03.029128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53853a9b-439f-44c0-8be6-2daf6087624d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:03.136553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c56d2a-ea43-4333-9f82-e3581da4a1c9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:03.160297 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53853a9b-439f-44c0-8be6-2daf6087624d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:03.177556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:03.185137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0c327-7513-4f92-8ff6-20fa81152d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:03.185752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0c327-7513-4f92-8ff6-20fa81152d3b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:03.186028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0c327-7513-4f92-8ff6-20fa81152d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:03.186297 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0c327-7513-4f92-8ff6-20fa81152d3b None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:03.187001 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0c327-7513-4f92-8ff6-20fa81152d3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:03.187303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0c327-7513-4f92-8ff6-20fa81152d3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:03.189647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0c327-7513-4f92-8ff6-20fa81152d3b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:03.204237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af98cb-b431-440c-84a1-437a163082ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:03.205368 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af98cb-b431-440c-84a1-437a163082ff None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:03.206048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af98cb-b431-440c-84a1-437a163082ff None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:03.206160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 342/680] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:03.207192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0c327-7513-4f92-8ff6-20fa81152d3b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:03.207818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af98cb-b431-440c-84a1-437a163082ff None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:03.212631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af98cb-b431-440c-84a1-437a163082ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:03.213324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af98cb-b431-440c-84a1-437a163082ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:03.215048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af98cb-b431-440c-84a1-437a163082ff None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:03.230530 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 339/681] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:03.231827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af98cb-b431-440c-84a1-437a163082ff None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:03.292544 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:03.339065 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0c327-7513-4f92-8ff6-20fa81152d3b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:03.345012 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af98cb-b431-440c-84a1-437a163082ff None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:03.379710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c1114-f658-4fb4-beb4-62e46ac65d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:03.380780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c1114-f658-4fb4-beb4-62e46ac65d70 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:03.381347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c1114-f658-4fb4-beb4-62e46ac65d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:03.381846 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c1114-f658-4fb4-beb4-62e46ac65d70 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:03.382608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c1114-f658-4fb4-beb4-62e46ac65d70 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:03.382908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c1114-f658-4fb4-beb4-62e46ac65d70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:03.384355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c1114-f658-4fb4-beb4-62e46ac65d70 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:03.387886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e921d-8c4c-4fe2-97b5-80f42d75340d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:03.389235 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e921d-8c4c-4fe2-97b5-80f42d75340d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:03.389705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e921d-8c4c-4fe2-97b5-80f42d75340d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:03.390159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e921d-8c4c-4fe2-97b5-80f42d75340d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:03.391074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e921d-8c4c-4fe2-97b5-80f42d75340d None admin] RBAC: Adding query filter params (role.id=ee7f9512e7e745199ff5ed847343d11a, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=b88d0d18ad66438191541b84fc1431bf) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:03.391586 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e921d-8c4c-4fe2-97b5-80f42d75340d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:03.394212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e921d-8c4c-4fe2-97b5-80f42d75340d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:03.401124 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 340/682] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:12:03 2022] GET /identity/v3/role_assignments?user.id=b88d0d18ad66438191541b84fc1431bf&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=ee7f9512e7e745199ff5ed847343d11a => generated 610 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:03.402327 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e921d-8c4c-4fe2-97b5-80f42d75340d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:03.415551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 343/683] 10.222.0.107 () {56 vars in 1140 bytes} [Tue Aug 23 23:12:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:03.417260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fba94e-4bbb-4ffc-a9d3-bf51677b3615 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:03.417724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fba94e-4bbb-4ffc-a9d3-bf51677b3615 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:03.418429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fba94e-4bbb-4ffc-a9d3-bf51677b3615 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:03.426219 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 344/684] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:03 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:03.427414 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fba94e-4bbb-4ffc-a9d3-bf51677b3615 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:03.466764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:03.549775 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fba94e-4bbb-4ffc-a9d3-bf51677b3615 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:03.559655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e921d-8c4c-4fe2-97b5-80f42d75340d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:03.570863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:03.592091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146fe29-e35a-4124-b71f-3ed12c054c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:03.593395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146fe29-e35a-4124-b71f-3ed12c054c6b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:03.593877 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146fe29-e35a-4124-b71f-3ed12c054c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:03.594445 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146fe29-e35a-4124-b71f-3ed12c054c6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:03.604500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b7ba5-a47f-49c4-8aef-9023f79d4c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:03.605265 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b7ba5-a47f-49c4-8aef-9023f79d4c45 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:03.605544 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b7ba5-a47f-49c4-8aef-9023f79d4c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:03.605836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b7ba5-a47f-49c4-8aef-9023f79d4c45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:03.606552 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b7ba5-a47f-49c4-8aef-9023f79d4c45 None admin] RBAC: Adding query filter params (role.id=ee7f9512e7e745199ff5ed847343d11a, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=a43ac193836248959a0380a76549ec10) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:03.606863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b7ba5-a47f-49c4-8aef-9023f79d4c45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:03.608954 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b7ba5-a47f-49c4-8aef-9023f79d4c45 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:03.617875 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 341/685] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:12:03 2022] GET /identity/v3/role_assignments?user.id=a43ac193836248959a0380a76549ec10&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=ee7f9512e7e745199ff5ed847343d11a => generated 610 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:03.620708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afe2b9-bf2e-4e68-b109-1f416f0c09d1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:03.620994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afe2b9-bf2e-4e68-b109-1f416f0c09d1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:03.621271 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afe2b9-bf2e-4e68-b109-1f416f0c09d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:03.645194 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-70afe2b9-bf2e-4e68-b109-1f416f0c09d1 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:03.647820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-70afe2b9-bf2e-4e68-b109-1f416f0c09d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:03.699138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146fe29-e35a-4124-b71f-3ed12c054c6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:03.700847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146fe29-e35a-4124-b71f-3ed12c054c6b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:03.763161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 342/686] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:03.855355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 345/687] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:12:03 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:03.861339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afe2b9-bf2e-4e68-b109-1f416f0c09d1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:03.900098 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:03.978737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afe2b9-bf2e-4e68-b109-1f416f0c09d1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:04.025688 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ac2ac-2dd1-406a-859a-200a87907ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:04.026338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ac2ac-2dd1-406a-859a-200a87907ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:04.026617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ac2ac-2dd1-406a-859a-200a87907ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:04.026896 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ac2ac-2dd1-406a-859a-200a87907ce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:04.040210 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ac2ac-2dd1-406a-859a-200a87907ce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:04.041982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ac2ac-2dd1-406a-859a-200a87907ce6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:04.053569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146fe29-e35a-4124-b71f-3ed12c054c6b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:04.058160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-107ac2ac-2dd1-406a-859a-200a87907ce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:04.058160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:04.058160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:04.058160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:04.058160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:04.058160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:04.058160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:04.058160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:04.058160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:04.058160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:04.058160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:04.058160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:04.058160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:04.058160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:04.058160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:04.058160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:04.059278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:04.059278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:04.059278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:04.059278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:04.059278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:04.059278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:04.059278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:04.059278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:04.059278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:04.059278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:04.059278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:04.059278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:04.059278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:04.059278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:04.059278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:04.059278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:04.059278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:04.060383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:04.060383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:04.060383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:04.062106 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 343/688] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:04.068845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ac2ac-2dd1-406a-859a-200a87907ce6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:04.081339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:04.164393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:04.178173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146fe29-e35a-4124-b71f-3ed12c054c6b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:04.183350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ac2ac-2dd1-406a-859a-200a87907ce6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:04.219901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701b421-d0be-42f6-84a8-0395c37e1ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:04.220118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732ef6b-156e-4f6d-92ac-1886868fcb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:04.220503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b421-d0be-42f6-84a8-0395c37e1ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:04.220829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b421-d0be-42f6-84a8-0395c37e1ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:04.220937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732ef6b-156e-4f6d-92ac-1886868fcb4b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:04.221101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b421-d0be-42f6-84a8-0395c37e1ec6 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:04.221426 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732ef6b-156e-4f6d-92ac-1886868fcb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:04.221745 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701b421-d0be-42f6-84a8-0395c37e1ec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:04.221855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732ef6b-156e-4f6d-92ac-1886868fcb4b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:04.222042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701b421-d0be-42f6-84a8-0395c37e1ec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:04.222599 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732ef6b-156e-4f6d-92ac-1886868fcb4b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:04.223529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701b421-d0be-42f6-84a8-0395c37e1ec6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:04.224129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732ef6b-156e-4f6d-92ac-1886868fcb4b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:04.237704 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 344/689] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:04.238049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-0732ef6b-156e-4f6d-92ac-1886868fcb4b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:12:04.238049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:04.238049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:04.238049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:04.238049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:04.238049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:04.238049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:04.238049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:04.238049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:12:04.238049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:04.238049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:04.238049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:04.238049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:04.238049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:04.238049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:04.238049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:04.238049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:04.239319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:04.239319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:04.239319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:04.239319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:04.239319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:04.239319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:04.239319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:04.239319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:04.239319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:04.239319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:04.239319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:04.239319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:04.239319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:04.239319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:04.239319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:04.239319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:04.240395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:04.240395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:04.240395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:04.240395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:04.240395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:04.240395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:04.240395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:04.240395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:04.240395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:04.240395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:04.240395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:04.240395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:04.240395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:12:04.240395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:04.243118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 346/690] 10.222.0.107 () {56 vars in 1134 bytes} [Tue Aug 23 23:12:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:04.244124 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701b421-d0be-42f6-84a8-0395c37e1ec6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:04.248836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732ef6b-156e-4f6d-92ac-1886868fcb4b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:04.396170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:04.409675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701b421-d0be-42f6-84a8-0395c37e1ec6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:04.439459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732ef6b-156e-4f6d-92ac-1886868fcb4b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:04.478680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1cd94-0a39-45cd-9da1-8dda7269251d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:04.479312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1cd94-0a39-45cd-9da1-8dda7269251d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:04.479584 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1cd94-0a39-45cd-9da1-8dda7269251d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:04.479850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1cd94-0a39-45cd-9da1-8dda7269251d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:04.489583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1cd94-0a39-45cd-9da1-8dda7269251d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:04.491731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1cd94-0a39-45cd-9da1-8dda7269251d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:04.512509 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fddb2-7777-4b13-ba93-a92396d492a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:04.513133 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fddb2-7777-4b13-ba93-a92396d492a3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:04.513462 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fddb2-7777-4b13-ba93-a92396d492a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:04.513738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fddb2-7777-4b13-ba93-a92396d492a3 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:04.514371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fddb2-7777-4b13-ba93-a92396d492a3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:04.514670 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fddb2-7777-4b13-ba93-a92396d492a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:04.516033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fddb2-7777-4b13-ba93-a92396d492a3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:04.518770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-75d1cd94-0a39-45cd-9da1-8dda7269251d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:04.518770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:04.518770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:04.518770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:04.518770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:04.518770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:04.518770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:04.518770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:04.518770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:04.518770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:04.518770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:04.518770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:04.518770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:04.518770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:04.518770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:04.519934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:04.519934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:04.519934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:04.519934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:04.519934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:04.519934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:04.519934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:04.519934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:04.519934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:04.519934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:04.519934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:04.519934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:04.519934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:04.519934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:04.519934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:04.519934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:04.519934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:04.521217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:04.521217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:04.521217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:04.521217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:04.521217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:04.521217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:04.521217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:04.521217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:04.521217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 345/691] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:04.527441 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1cd94-0a39-45cd-9da1-8dda7269251d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:04.531738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 347/692] 10.222.0.107 () {56 vars in 1129 bytes} [Tue Aug 23 23:12:04 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:04.537411 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fddb2-7777-4b13-ba93-a92396d492a3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:04.545782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:04.671936 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1cd94-0a39-45cd-9da1-8dda7269251d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:04.709362 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e206ef-f181-4c8d-b19a-463dba4371cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:04.710729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fddb2-7777-4b13-ba93-a92396d492a3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:04.711188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e206ef-f181-4c8d-b19a-463dba4371cb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:04.711279 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e206ef-f181-4c8d-b19a-463dba4371cb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:04.711666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e206ef-f181-4c8d-b19a-463dba4371cb None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:04.712435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e206ef-f181-4c8d-b19a-463dba4371cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:04.713076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e206ef-f181-4c8d-b19a-463dba4371cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:04.715506 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e206ef-f181-4c8d-b19a-463dba4371cb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:04.732649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 346/693] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:04.734542 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e127646-a456-4b4f-9cdb-dac7671861cc None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:04.734822 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e127646-a456-4b4f-9cdb-dac7671861cc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:04.735092 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e127646-a456-4b4f-9cdb-dac7671861cc None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:04.736886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 347/694] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:04.745997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7424001-ea4a-4301-a9f6-205f89789f2e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:04.746304 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7424001-ea4a-4301-a9f6-205f89789f2e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:04.746542 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7424001-ea4a-4301-a9f6-205f89789f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:04.764409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca2a39-7f18-4a4e-ac16-5c002c5e6afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:04.765224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a7424001-ea4a-4301-a9f6-205f89789f2e None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:04.765834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca2a39-7f18-4a4e-ac16-5c002c5e6afe None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:04.766436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a7424001-ea4a-4301-a9f6-205f89789f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:04.766653 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca2a39-7f18-4a4e-ac16-5c002c5e6afe None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:04.767265 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca2a39-7f18-4a4e-ac16-5c002c5e6afe None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:04.768666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca2a39-7f18-4a4e-ac16-5c002c5e6afe None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:04.769371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca2a39-7f18-4a4e-ac16-5c002c5e6afe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:04.771258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca2a39-7f18-4a4e-ac16-5c002c5e6afe None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:04.784958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 348/695] 10.222.0.107 () {56 vars in 1129 bytes} [Tue Aug 23 23:12:04 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:04.785899 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca2a39-7f18-4a4e-ac16-5c002c5e6afe None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:04.821656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:04.843108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:04.851100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 348/696] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:04.943823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca2a39-7f18-4a4e-ac16-5c002c5e6afe None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:04.982592 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5c388-39ae-4fc8-b98b-83f544e5c457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:04.983557 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5c388-39ae-4fc8-b98b-83f544e5c457 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:04.984057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5c388-39ae-4fc8-b98b-83f544e5c457 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:04.984530 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5c388-39ae-4fc8-b98b-83f544e5c457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:04.985495 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5c388-39ae-4fc8-b98b-83f544e5c457 None admin] RBAC: Adding query filter params (role.id=ee7f9512e7e745199ff5ed847343d11a, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=35d0b95b22bc4117957cbc3afa5547a4) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:04.986019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5c388-39ae-4fc8-b98b-83f544e5c457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:04.987720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5c388-39ae-4fc8-b98b-83f544e5c457 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:04.995248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 349/697] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:12:04 2022] GET /identity/v3/role_assignments?user.id=35d0b95b22bc4117957cbc3afa5547a4&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=ee7f9512e7e745199ff5ed847343d11a => generated 610 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:05.253088 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7424001-ea4a-4301-a9f6-205f89789f2e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:05.369559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7424001-ea4a-4301-a9f6-205f89789f2e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:05.405920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadae2cf-871d-4dbe-b648-e9da359918ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:05.406551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadae2cf-871d-4dbe-b648-e9da359918ea None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:05.406824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadae2cf-871d-4dbe-b648-e9da359918ea None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:05.407091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadae2cf-871d-4dbe-b648-e9da359918ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:05.417513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadae2cf-871d-4dbe-b648-e9da359918ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:05.422429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-dadae2cf-871d-4dbe-b648-e9da359918ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:05.422429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:05.422429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:05.422429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:05.422429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:05.422429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:05.422429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:05.422429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:05.422429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:05.422429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:05.422429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:05.422429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:05.422429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:05.422429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:05.422429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:05.422429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:05.423391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:05.423391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:05.423391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:05.423391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:05.423391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:05.423391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:05.423391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:05.423391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:05.423391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:05.423391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:05.423391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:05.423391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:05.423391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:05.423391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:05.423391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:05.423391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:05.424250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:05.424250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:05.424250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:05.424250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:05.424250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:05.424250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:05.424250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:05.424250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:05.424250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:05.424250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:05.424250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:05.424250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:05.424250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 349/698] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:05.430764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5c388-39ae-4fc8-b98b-83f544e5c457 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:05.527606 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:05.558274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5c388-39ae-4fc8-b98b-83f544e5c457 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:05.603863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10b0bc-02f7-4c63-8e9b-07ba9b6415e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:05.604797 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10b0bc-02f7-4c63-8e9b-07ba9b6415e5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:05.605225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10b0bc-02f7-4c63-8e9b-07ba9b6415e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:05.605647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10b0bc-02f7-4c63-8e9b-07ba9b6415e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:05.606875 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10b0bc-02f7-4c63-8e9b-07ba9b6415e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:05.607350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10b0bc-02f7-4c63-8e9b-07ba9b6415e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:05.609297 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10b0bc-02f7-4c63-8e9b-07ba9b6415e5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:05.620871 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 350/699] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:12:05 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:05.626339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadae2cf-871d-4dbe-b648-e9da359918ea None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:05.691097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:05.753490 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadae2cf-871d-4dbe-b648-e9da359918ea None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:05.810754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a5a65-9a34-456b-81d6-1b3b6ea56ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:05.811368 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a5a65-9a34-456b-81d6-1b3b6ea56ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:05.811648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a5a65-9a34-456b-81d6-1b3b6ea56ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:05.811915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a5a65-9a34-456b-81d6-1b3b6ea56ad9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:05.826596 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a5a65-9a34-456b-81d6-1b3b6ea56ad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:05.829241 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a5a65-9a34-456b-81d6-1b3b6ea56ad9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:05.856638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9e3a5a65-9a34-456b-81d6-1b3b6ea56ad9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:05.856638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:05.856638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:05.856638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:05.856638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:05.856638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:05.856638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:05.856638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:05.856638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:05.856638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:05.856638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:05.856638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:05.856638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:05.856638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:05.856638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:05.856638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:05.857636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:05.857636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:05.857636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:05.857636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:05.857636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:05.857636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:05.857636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:05.857636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:05.857636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:05.857636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:05.857636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:05.857636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:05.857636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:05.857636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:05.857636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:05.857636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:05.857636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:05.858519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:05.858519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:05.858519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:05.858519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 350/700] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:05.864610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10b0bc-02f7-4c63-8e9b-07ba9b6415e5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:05.934519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6119f3-b15c-48f5-b172-b060f8bd5e5c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:05.934845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6119f3-b15c-48f5-b172-b060f8bd5e5c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:05.935064 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6119f3-b15c-48f5-b172-b060f8bd5e5c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:05.937667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 351/701] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:05.942045 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878df924-d99c-4fc1-9cd8-25fe63f8e985 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:05.942324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878df924-d99c-4fc1-9cd8-25fe63f8e985 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:05.942597 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878df924-d99c-4fc1-9cd8-25fe63f8e985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:05.961679 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-878df924-d99c-4fc1-9cd8-25fe63f8e985 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:05.962951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-878df924-d99c-4fc1-9cd8-25fe63f8e985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:06.052702 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 352/702] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:06.092237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10b0bc-02f7-4c63-8e9b-07ba9b6415e5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:06.148526 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922812ee-fdf5-47d7-827e-f442d542ff4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:06.149700 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922812ee-fdf5-47d7-827e-f442d542ff4b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.150362 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922812ee-fdf5-47d7-827e-f442d542ff4b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.150986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922812ee-fdf5-47d7-827e-f442d542ff4b None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.152383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922812ee-fdf5-47d7-827e-f442d542ff4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:06.153081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922812ee-fdf5-47d7-827e-f442d542ff4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:06.155175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922812ee-fdf5-47d7-827e-f442d542ff4b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:06.161894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:06.177647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 351/703] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:06.182883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878df924-d99c-4fc1-9cd8-25fe63f8e985 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:06.233374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:06.302480 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878df924-d99c-4fc1-9cd8-25fe63f8e985 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:06.338774 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f4a0c-70a3-49f7-9119-899e298a3de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:06.339789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f4a0c-70a3-49f7-9119-899e298a3de6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.340280 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f4a0c-70a3-49f7-9119-899e298a3de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.340784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f4a0c-70a3-49f7-9119-899e298a3de6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.348567 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f4a0c-70a3-49f7-9119-899e298a3de6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:06.350791 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f4a0c-70a3-49f7-9119-899e298a3de6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:06.362785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-669f4a0c-70a3-49f7-9119-899e298a3de6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:12:06.362785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:06.362785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:06.362785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:06.362785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:06.362785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:06.362785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:06.362785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:06.362785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:06.362785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:06.362785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:06.362785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:06.362785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:06.362785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:06.362785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:06.362785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:06.363825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:06.363825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:06.363825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:06.363825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:06.363825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:06.363825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:06.363825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:06.363825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:06.363825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:06.363825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:06.363825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:06.363825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:06.363825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:06.363825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:06.363825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:06.363825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:06.363825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:06.363825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:06.364800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:06.364800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:06.364800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:06.364800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:06.364800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:06.364800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:06.364800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:06.364800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:06.364800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:12:06.364800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:06.367940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 353/704] 10.222.0.107 () {56 vars in 1098 bytes} [Tue Aug 23 23:12:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:06.373698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922812ee-fdf5-47d7-827e-f442d542ff4b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:06.417861 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969dd57-226e-4435-b3d5-787e88cb2de1 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.418820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969dd57-226e-4435-b3d5-787e88cb2de1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.419319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969dd57-226e-4435-b3d5-787e88cb2de1 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.421193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 354/705] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:06.426879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767ea46-fa73-4e17-b07f-31e9ca199430 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.427423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767ea46-fa73-4e17-b07f-31e9ca199430 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.427894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767ea46-fa73-4e17-b07f-31e9ca199430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.447823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e767ea46-fa73-4e17-b07f-31e9ca199430 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:06.449466 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e767ea46-fa73-4e17-b07f-31e9ca199430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:06.535266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922812ee-fdf5-47d7-827e-f442d542ff4b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:06.540761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 355/706] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:12:06.541596 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767ea46-fa73-4e17-b07f-31e9ca199430 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:06.597254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:06.605746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f910b56-8162-4f6c-a3ac-a9cec985ca47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:06.606551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f910b56-8162-4f6c-a3ac-a9cec985ca47 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.606833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f910b56-8162-4f6c-a3ac-a9cec985ca47 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.607104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f910b56-8162-4f6c-a3ac-a9cec985ca47 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.607842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f910b56-8162-4f6c-a3ac-a9cec985ca47 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:06.608145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f910b56-8162-4f6c-a3ac-a9cec985ca47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:06.610127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f910b56-8162-4f6c-a3ac-a9cec985ca47 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:06.630992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 352/707] 10.222.0.107 () {56 vars in 1138 bytes} [Tue Aug 23 23:12:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:06.637638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f910b56-8162-4f6c-a3ac-a9cec985ca47 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:06.745856 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:06.752728 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767ea46-fa73-4e17-b07f-31e9ca199430 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:06.804970 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f910b56-8162-4f6c-a3ac-a9cec985ca47 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:06.843081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d9409-7a54-4a6b-ab56-3433afe5ebc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:06.844068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d9409-7a54-4a6b-ab56-3433afe5ebc4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.844547 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d9409-7a54-4a6b-ab56-3433afe5ebc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.845064 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d9409-7a54-4a6b-ab56-3433afe5ebc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.847080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982d0bd-57df-4919-8f6b-8451463aa154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:06.847763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982d0bd-57df-4919-8f6b-8451463aa154 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:06.848037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982d0bd-57df-4919-8f6b-8451463aa154 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:06.848302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982d0bd-57df-4919-8f6b-8451463aa154 None admin] PATH_INFO: `/v3/services/network` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:06.848995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982d0bd-57df-4919-8f6b-8451463aa154 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:06.851046 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982d0bd-57df-4919-8f6b-8451463aa154 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:06.874604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-0982d0bd-57df-4919-8f6b-8451463aa154 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:12:06.874604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:06.874604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:06.874604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:06.874604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:06.874604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:06.874604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:06.874604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:06.874604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:12:06.874604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:06.874604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:06.874604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:06.874604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:06.874604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:06.874604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:06.874604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:06.874604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:06.875686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:06.875686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:06.875686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:06.875686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:06.875686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:06.875686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:06.875686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:06.875686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:06.875686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:06.875686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:06.875686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:06.875686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:06.875686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:06.875686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:06.875686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:06.875686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:06.877167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:06.877167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:06.877167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:06.877167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:06.877167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:06.877167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:06.877167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:06.877167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:06.877167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:06.877167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:06.877167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:06.877167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:06.877167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:12:06.877167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:06.877167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 356/708] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:06 2022] GET /identity/v3/services/network => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:06.881253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982d0bd-57df-4919-8f6b-8451463aa154 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:06.927973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d9409-7a54-4a6b-ab56-3433afe5ebc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:06.930439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d9409-7a54-4a6b-ab56-3433afe5ebc4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:06.989984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:07.029015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:07.037621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982d0bd-57df-4919-8f6b-8451463aa154 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:07.043287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 353/709] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:12:06 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:12:07.044313 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d9409-7a54-4a6b-ab56-3433afe5ebc4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:07.078079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78008254-ff11-486c-a1b9-40d0d855d93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:07.078930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78008254-ff11-486c-a1b9-40d0d855d93d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.079351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78008254-ff11-486c-a1b9-40d0d855d93d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.079794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78008254-ff11-486c-a1b9-40d0d855d93d None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.080748 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78008254-ff11-486c-a1b9-40d0d855d93d None admin] RBAC: Adding query filter params (name=network) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:07.081197 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78008254-ff11-486c-a1b9-40d0d855d93d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:07.082685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78008254-ff11-486c-a1b9-40d0d855d93d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:07.088524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 357/710] 10.222.0.107 () {56 vars in 1117 bytes} [Tue Aug 23 23:12:06 2022] GET /identity/v3/services?name=network => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:07.089722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78008254-ff11-486c-a1b9-40d0d855d93d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:07.150250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d9409-7a54-4a6b-ab56-3433afe5ebc4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:07.185837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfb693-9ced-45bd-a310-c9499bbd6fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:07.186642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfb693-9ced-45bd-a310-c9499bbd6fcb None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.187017 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfb693-9ced-45bd-a310-c9499bbd6fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.187384 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfb693-9ced-45bd-a310-c9499bbd6fcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.200707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfb693-9ced-45bd-a310-c9499bbd6fcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:07.202322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfb693-9ced-45bd-a310-c9499bbd6fcb None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:07.202893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78008254-ff11-486c-a1b9-40d0d855d93d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:07.218338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-57dfb693-9ced-45bd-a310-c9499bbd6fcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:07.218338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:07.218338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:07.218338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:07.218338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:07.218338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:07.218338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:07.218338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:07.218338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:07.218338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:07.218338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:07.218338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:07.218338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:07.218338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:07.218338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:07.218338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:07.219517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:07.219517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:07.219517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:07.219517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:07.219517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:07.219517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:07.219517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:07.219517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:07.219517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:07.219517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:07.219517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:07.219517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:07.219517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:07.219517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:07.219517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:07.219517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:07.219517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:07.220396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:07.220396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:07.220396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:07.224429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 354/711] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:07.225928 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfb693-9ced-45bd-a310-c9499bbd6fcb None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:07.235636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:07.245384 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147bcf7-70ca-4cca-9055-cbc9133c2dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:07.246022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147bcf7-70ca-4cca-9055-cbc9133c2dac None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.246299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147bcf7-70ca-4cca-9055-cbc9133c2dac None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.246568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147bcf7-70ca-4cca-9055-cbc9133c2dac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.259611 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147bcf7-70ca-4cca-9055-cbc9133c2dac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:07.261258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147bcf7-70ca-4cca-9055-cbc9133c2dac None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:07.277824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9147bcf7-70ca-4cca-9055-cbc9133c2dac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:07.277824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:07.277824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:07.277824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:07.277824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:07.277824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:07.277824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:07.277824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:07.277824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:07.277824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:07.277824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:07.277824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:07.277824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:07.277824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:07.277824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:07.277824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:07.278845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:07.278845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:07.278845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:07.278845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:07.278845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:07.278845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:07.278845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:07.278845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:07.278845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:07.278845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:07.278845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:07.278845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:07.278845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:07.278845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:07.278845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:07.278845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:07.278845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:07.279722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:07.279722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:07.279722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:07.279722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 358/712] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:07.280795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3aefc-661a-4fdf-903c-74b6a76731fb None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.280795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3aefc-661a-4fdf-903c-74b6a76731fb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.281063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3aefc-661a-4fdf-903c-74b6a76731fb None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.284640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 359/713] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:07.284640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3aefc-661a-4fdf-903c-74b6a76731fb None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:07.293035 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:07.347101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfb693-9ced-45bd-a310-c9499bbd6fcb None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:07.381236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2f2ee-c1f9-4cf1-ab1e-76a030498dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:07.382657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2f2ee-c1f9-4cf1-ab1e-76a030498dea None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.383070 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2f2ee-c1f9-4cf1-ab1e-76a030498dea None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.383346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2f2ee-c1f9-4cf1-ab1e-76a030498dea None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.383980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2f2ee-c1f9-4cf1-ab1e-76a030498dea None admin] RBAC: Adding query filter params (type=network) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:07.384285 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2f2ee-c1f9-4cf1-ab1e-76a030498dea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:07.385700 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2f2ee-c1f9-4cf1-ab1e-76a030498dea None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:07.390520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 355/714] 10.222.0.107 () {56 vars in 1117 bytes} [Tue Aug 23 23:12:07 2022] GET /identity/v3/services?type=network => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:07.391335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2f2ee-c1f9-4cf1-ab1e-76a030498dea None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:07.422253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3aefc-661a-4fdf-903c-74b6a76731fb None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:07.468053 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99f745-4985-4fe8-826c-a309b4f9ac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:07.469029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99f745-4985-4fe8-826c-a309b4f9ac88 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.469455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99f745-4985-4fe8-826c-a309b4f9ac88 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.469875 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99f745-4985-4fe8-826c-a309b4f9ac88 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.470680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99f745-4985-4fe8-826c-a309b4f9ac88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:07.471167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99f745-4985-4fe8-826c-a309b4f9ac88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:07.472772 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99f745-4985-4fe8-826c-a309b4f9ac88 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:07.479895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:07.487472 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 360/715] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:07.489217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc088761-14f9-481b-a80e-9af82dc3b3d0 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.489713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc088761-14f9-481b-a80e-9af82dc3b3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.490162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc088761-14f9-481b-a80e-9af82dc3b3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.511014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-dc088761-14f9-481b-a80e-9af82dc3b3d0 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:07.512555 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dc088761-14f9-481b-a80e-9af82dc3b3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:07.517467 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2f2ee-c1f9-4cf1-ab1e-76a030498dea None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:07.558236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b6877-02de-4b59-b357-219d4adbf7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:07.558698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b6877-02de-4b59-b357-219d4adbf7cd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.558976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b6877-02de-4b59-b357-219d4adbf7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.559249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b6877-02de-4b59-b357-219d4adbf7cd None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.559924 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b6877-02de-4b59-b357-219d4adbf7cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:07.560226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b6877-02de-4b59-b357-219d4adbf7cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:07.561940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b6877-02de-4b59-b357-219d4adbf7cd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:07.582100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 356/716] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:07.582100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b6877-02de-4b59-b357-219d4adbf7cd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:07.586605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:07.597223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 361/717] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:07.598310 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc088761-14f9-481b-a80e-9af82dc3b3d0 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:07.768788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b6877-02de-4b59-b357-219d4adbf7cd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:07.784401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc088761-14f9-481b-a80e-9af82dc3b3d0 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:07.822670 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:07.831238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138a2fe-2323-40f0-aa1b-f8ce746e9bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:07.831844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138a2fe-2323-40f0-aa1b-f8ce746e9bec None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.832120 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138a2fe-2323-40f0-aa1b-f8ce746e9bec None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.832392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138a2fe-2323-40f0-aa1b-f8ce746e9bec None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.833131 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138a2fe-2323-40f0-aa1b-f8ce746e9bec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:07.833315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e836f73-c9b9-4ac8-a7fe-b6c7371033c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:07.833893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e836f73-c9b9-4ac8-a7fe-b6c7371033c7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.834244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e836f73-c9b9-4ac8-a7fe-b6c7371033c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.834831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e836f73-c9b9-4ac8-a7fe-b6c7371033c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.835011 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138a2fe-2323-40f0-aa1b-f8ce746e9bec None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:07.845316 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e836f73-c9b9-4ac8-a7fe-b6c7371033c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:07.846762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e836f73-c9b9-4ac8-a7fe-b6c7371033c7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:07.860823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-7e836f73-c9b9-4ac8-a7fe-b6c7371033c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:07.860823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:07.860823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:07.860823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:07.860823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:07.860823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:07.860823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:07.860823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:07.860823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:07.860823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:07.860823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:07.860823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:07.860823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:07.860823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:07.860823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:07.861755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:07.861755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:07.861755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:07.861755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:07.861755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:07.861755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:07.861755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:07.861755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:07.861755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:07.861755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:07.861755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:07.861755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:07.861755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:07.861755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:07.861755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:07.861755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:07.861755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:07.862662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:07.862662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:07.862662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:07.862662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:07.862662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:07.862662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:07.862662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:07.862662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:07.862662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 362/718] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:07.863667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea9c0b-640d-4e5f-8fb5-a5f2295ddf72 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.864500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea9c0b-640d-4e5f-8fb5-a5f2295ddf72 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.864500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea9c0b-640d-4e5f-8fb5-a5f2295ddf72 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.870631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 363/719] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:07.871486 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea9c0b-640d-4e5f-8fb5-a5f2295ddf72 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:07.872485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 357/720] 10.222.0.107 () {60 vars in 1137 bytes} [Tue Aug 23 23:12:07 2022] POST /identity/v3/users => generated 255 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:07.873873 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee57c4-bc7c-428e-9f8c-638eca675d07 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:07.874164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee57c4-bc7c-428e-9f8c-638eca675d07 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:07.874758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee57c4-bc7c-428e-9f8c-638eca675d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:07.898359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0dee57c4-bc7c-428e-9f8c-638eca675d07 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:07.900151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0dee57c4-bc7c-428e-9f8c-638eca675d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:07.972372 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:08.005148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 358/721] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:12:08.006175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee57c4-bc7c-428e-9f8c-638eca675d07 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:08.055583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea9c0b-640d-4e5f-8fb5-a5f2295ddf72 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:08.097497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fc7c5-0920-4536-9f09-476d70155654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:08.099091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc7c5-0920-4536-9f09-476d70155654 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:08.099388 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc7c5-0920-4536-9f09-476d70155654 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:08.099664 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc7c5-0920-4536-9f09-476d70155654 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:08.100961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fc7c5-0920-4536-9f09-476d70155654 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:08.101270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fc7c5-0920-4536-9f09-476d70155654 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:08.102835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fc7c5-0920-4536-9f09-476d70155654 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:08.118010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 364/722] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:08.123897 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fc7c5-0920-4536-9f09-476d70155654 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:08.136001 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee57c4-bc7c-428e-9f8c-638eca675d07 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:08.159054 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:08.188858 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114a052-3a1c-40fe-9c6b-2aa15dd912a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:08.189821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114a052-3a1c-40fe-9c6b-2aa15dd912a6 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:08.190107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114a052-3a1c-40fe-9c6b-2aa15dd912a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:08.190641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114a052-3a1c-40fe-9c6b-2aa15dd912a6 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:08.191726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114a052-3a1c-40fe-9c6b-2aa15dd912a6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:08.193697 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114a052-3a1c-40fe-9c6b-2aa15dd912a6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:08.220705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 359/723] 10.222.0.107 () {60 vars in 1146 bytes} [Tue Aug 23 23:12:08 2022] POST /identity/v3/services => generated 252 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:08.254088 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fc7c5-0920-4536-9f09-476d70155654 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:08.275531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:08.307612 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f7976-5049-465c-b746-f01ba607a828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:08.308213 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f7976-5049-465c-b746-f01ba607a828 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:08.308499 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f7976-5049-465c-b746-f01ba607a828 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:08.308821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f7976-5049-465c-b746-f01ba607a828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:08.309642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f7976-5049-465c-b746-f01ba607a828 None admin] RBAC: Adding query filter params (role.id=97ece22f2e264e0e857d5107325a85d9, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=2f985626d8af4f3089e72998fad98b47) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:08.309966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f7976-5049-465c-b746-f01ba607a828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:08.311538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f7976-5049-465c-b746-f01ba607a828 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:08.318461 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 365/724] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:12:08 2022] GET /identity/v3/role_assignments?user.id=2f985626d8af4f3089e72998fad98b47&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:08.337247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114a052-3a1c-40fe-9c6b-2aa15dd912a6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:08.479444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114a052-3a1c-40fe-9c6b-2aa15dd912a6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:08.516378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849e3ed-0690-46cd-8be1-d9ead4adac28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:08.517418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849e3ed-0690-46cd-8be1-d9ead4adac28 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:08.517943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849e3ed-0690-46cd-8be1-d9ead4adac28 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:08.518422 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849e3ed-0690-46cd-8be1-d9ead4adac28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:08.531922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849e3ed-0690-46cd-8be1-d9ead4adac28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:08.537685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d849e3ed-0690-46cd-8be1-d9ead4adac28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:08.537685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:08.537685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:08.537685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:08.537685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:08.537685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:08.537685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:08.537685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:08.537685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:08.537685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:08.537685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:08.537685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:08.537685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:08.537685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:08.537685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:08.537685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:08.539703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:08.539703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:08.539703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:08.539703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:08.539703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:08.539703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:08.539703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:08.539703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:08.539703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:08.539703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:08.539703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:08.539703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:08.539703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:08.539703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:08.539703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:08.539703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:08.540563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:08.540563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:08.540563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:08.540563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:08.540563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:08.540563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:08.540563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:08.540563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:08.540563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:08.540563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:08.540563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:08.540563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:08.543559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 360/725] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:08.549848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f7976-5049-465c-b746-f01ba607a828 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:08.682600 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f7976-5049-465c-b746-f01ba607a828 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:08.735029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f6888-e7bf-4bdb-97cc-dde1b0d103f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:08.735644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f6888-e7bf-4bdb-97cc-dde1b0d103f1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:08.735923 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f6888-e7bf-4bdb-97cc-dde1b0d103f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:08.736198 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f6888-e7bf-4bdb-97cc-dde1b0d103f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:08.736901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f6888-e7bf-4bdb-97cc-dde1b0d103f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:08.737202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f6888-e7bf-4bdb-97cc-dde1b0d103f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:08.738574 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f6888-e7bf-4bdb-97cc-dde1b0d103f1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:08.752157 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 366/726] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:12:08 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:08.758620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849e3ed-0690-46cd-8be1-d9ead4adac28 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:08.826579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:08.912169 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849e3ed-0690-46cd-8be1-d9ead4adac28 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:08.959143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376759fc-a719-4f19-b51c-0f15b74f8f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:08.959850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376759fc-a719-4f19-b51c-0f15b74f8f12 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:08.960294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376759fc-a719-4f19-b51c-0f15b74f8f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:08.961046 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376759fc-a719-4f19-b51c-0f15b74f8f12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:08.985262 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376759fc-a719-4f19-b51c-0f15b74f8f12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:08.986742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376759fc-a719-4f19-b51c-0f15b74f8f12 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:09.011889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-376759fc-a719-4f19-b51c-0f15b74f8f12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:09.011889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:09.011889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:09.011889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:09.011889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:09.011889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:09.011889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:09.011889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:09.011889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:09.011889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:09.011889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:09.011889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:09.011889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:09.011889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:09.011889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:09.011889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:09.013386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:09.013386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:09.013386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:09.013386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:09.013386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:09.013386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:09.013386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:09.013386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:09.013386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:09.013386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:09.013386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:09.013386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:09.013386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:09.013386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:09.013386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:09.013386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:09.013386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:09.014302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:09.014302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:09.014302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:09.014302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 361/727] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:09.018986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f6888-e7bf-4bdb-97cc-dde1b0d103f1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:09.097073 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:09.189796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f6888-e7bf-4bdb-97cc-dde1b0d103f1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:09.244778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba5db9-032d-4c8e-93a8-a438656d6fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:09.245307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba5db9-032d-4c8e-93a8-a438656d6fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:09.245585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba5db9-032d-4c8e-93a8-a438656d6fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:09.245854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba5db9-032d-4c8e-93a8-a438656d6fe7 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:09.246488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba5db9-032d-4c8e-93a8-a438656d6fe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:09.246785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba5db9-032d-4c8e-93a8-a438656d6fe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:09.248207 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba5db9-032d-4c8e-93a8-a438656d6fe7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:09.267933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 367/728] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:09.274223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376759fc-a719-4f19-b51c-0f15b74f8f12 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:09.413267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:09.426555 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376759fc-a719-4f19-b51c-0f15b74f8f12 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:09.470786 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965658e-294b-44b4-9374-db137798ee9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:09.471416 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965658e-294b-44b4-9374-db137798ee9f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:09.471692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965658e-294b-44b4-9374-db137798ee9f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:09.471961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965658e-294b-44b4-9374-db137798ee9f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:09.482758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965658e-294b-44b4-9374-db137798ee9f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:09.484203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965658e-294b-44b4-9374-db137798ee9f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:09.499835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-b965658e-294b-44b4-9374-db137798ee9f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:12:09.499835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:09.499835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:09.499835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:09.499835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:09.499835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:09.499835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:09.499835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:09.499835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:09.499835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:09.499835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:09.499835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:09.499835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:09.499835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:09.499835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:09.499835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:09.500844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:09.500844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:09.500844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:09.500844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:09.500844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:09.500844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:09.500844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:09.500844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:09.500844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:09.500844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:09.500844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:09.500844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:09.500844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:09.500844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:09.500844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:09.500844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:09.500844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:09.500844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:09.501778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:09.501778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:09.501778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:09.501778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:09.501778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:09.501778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:09.501778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:09.501778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:09.501778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:12:09.501778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:09.501778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 362/729] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:09.507374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba5db9-032d-4c8e-93a8-a438656d6fe7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:09.646730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:09.651780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba5db9-032d-4c8e-93a8-a438656d6fe7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:09.679625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a31566-3113-4439-9d71-5dd0b6d491e8 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:09.679625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a31566-3113-4439-9d71-5dd0b6d491e8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:09.679625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a31566-3113-4439-9d71-5dd0b6d491e8 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:09.680455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 363/730] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:12:09.685154 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6579ab4-efbf-4286-8c45-98befca3f23f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:09.685666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6579ab4-efbf-4286-8c45-98befca3f23f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:09.686267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6579ab4-efbf-4286-8c45-98befca3f23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:09.708064 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69b753-060e-4768-8ede-91e512ba3959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:09.708703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69b753-060e-4768-8ede-91e512ba3959 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:09.708982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69b753-060e-4768-8ede-91e512ba3959 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:09.709315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69b753-060e-4768-8ede-91e512ba3959 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:09.710336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69b753-060e-4768-8ede-91e512ba3959 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:09.710645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69b753-060e-4768-8ede-91e512ba3959 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:09.712379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69b753-060e-4768-8ede-91e512ba3959 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:09.713957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f6579ab4-efbf-4286-8c45-98befca3f23f None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:09.715367 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f6579ab4-efbf-4286-8c45-98befca3f23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:09.732041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 368/731] 10.222.0.107 () {56 vars in 1140 bytes} [Tue Aug 23 23:12:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:09.737834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69b753-060e-4768-8ede-91e512ba3959 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:09.859869 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69b753-060e-4768-8ede-91e512ba3959 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:09.875906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 364/732] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:09 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:12:09.900455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c05e5-e3e6-4185-bc41-a799384c962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:09.901431 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c05e5-e3e6-4185-bc41-a799384c962b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:09.901941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c05e5-e3e6-4185-bc41-a799384c962b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:09.902415 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c05e5-e3e6-4185-bc41-a799384c962b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:09.931794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:09.985478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c05e5-e3e6-4185-bc41-a799384c962b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:09.987340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c05e5-e3e6-4185-bc41-a799384c962b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:10.099929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 369/733] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:12:09 2022] GET /identity/v3/auth/tokens => generated 904 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:12:10.106482 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6579ab4-efbf-4286-8c45-98befca3f23f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:10.191017 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:10.214228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6579ab4-efbf-4286-8c45-98befca3f23f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:10.266260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2469a4-e36a-41d4-b7ec-95afb164f758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:10.266909 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2469a4-e36a-41d4-b7ec-95afb164f758 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:10.267256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2469a4-e36a-41d4-b7ec-95afb164f758 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:10.267531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2469a4-e36a-41d4-b7ec-95afb164f758 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:10.282663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2469a4-e36a-41d4-b7ec-95afb164f758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:10.284131 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2469a4-e36a-41d4-b7ec-95afb164f758 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:10.305257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-1f2469a4-e36a-41d4-b7ec-95afb164f758 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:10.305257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:10.305257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:10.305257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:10.305257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:10.305257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:10.305257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:10.305257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:10.305257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:10.305257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:10.305257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:10.305257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:10.305257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:10.305257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:10.305257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:10.305257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:10.306281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:10.306281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:10.306281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:10.306281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:10.306281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:10.306281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:10.306281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:10.306281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:10.306281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:10.306281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:10.306281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:10.306281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:10.306281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:10.306281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:10.306281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:10.306281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:10.306281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:10.307187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:10.307187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:10.307187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:10.307187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 365/734] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:10.313501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c05e5-e3e6-4185-bc41-a799384c962b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:10.347353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2469a4-e36a-41d4-b7ec-95afb164f758 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:10.430579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:10.456555 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2469a4-e36a-41d4-b7ec-95afb164f758 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:10.507514 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:10.516237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c05e5-e3e6-4185-bc41-a799384c962b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:10.517379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6968af-26f7-435b-b9ae-b6d07e386e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:10.518003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6968af-26f7-435b-b9ae-b6d07e386e70 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:10.518280 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6968af-26f7-435b-b9ae-b6d07e386e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:10.518549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6968af-26f7-435b-b9ae-b6d07e386e70 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:10.519214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6968af-26f7-435b-b9ae-b6d07e386e70 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:10.520670 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6968af-26f7-435b-b9ae-b6d07e386e70 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:10.550385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 366/735] 10.222.0.107 () {60 vars in 1146 bytes} [Tue Aug 23 23:12:10 2022] POST /identity/v3/services => generated 241 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:12:10.563166 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a994cc-38c5-4efa-a156-49216a04088c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:10.564065 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a994cc-38c5-4efa-a156-49216a04088c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:10.564496 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a994cc-38c5-4efa-a156-49216a04088c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:10.564943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a994cc-38c5-4efa-a156-49216a04088c None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:10.565840 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a994cc-38c5-4efa-a156-49216a04088c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:10.566301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a994cc-38c5-4efa-a156-49216a04088c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:10.568000 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a994cc-38c5-4efa-a156-49216a04088c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:10.583319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 370/736] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:10.590136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6968af-26f7-435b-b9ae-b6d07e386e70 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:10.721134 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6968af-26f7-435b-b9ae-b6d07e386e70 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:10.769093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181a15d-36e1-44c0-990d-e6922f70cc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:10.770050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181a15d-36e1-44c0-990d-e6922f70cc68 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:10.770473 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181a15d-36e1-44c0-990d-e6922f70cc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:10.770885 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181a15d-36e1-44c0-990d-e6922f70cc68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:10.782230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181a15d-36e1-44c0-990d-e6922f70cc68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:10.783909 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181a15d-36e1-44c0-990d-e6922f70cc68 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:10.797010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-c181a15d-36e1-44c0-990d-e6922f70cc68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:10.797010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:10.797010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:10.797010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:10.797010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:10.797010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:10.797010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:10.797010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:10.797010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:10.797010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:10.797010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:10.797010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:10.797010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:10.797010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:10.797010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:10.798111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:10.798111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:10.798111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:10.798111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:10.798111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:10.798111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:10.798111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:10.798111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:10.798111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:10.798111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:10.798111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:10.798111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:10.798111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:10.798111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:10.798111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:10.798111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:10.798111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:10.799282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:10.799282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:10.799282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:10.799282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:10.799282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:10.799282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:10.799282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:10.799282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:10.801313 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 367/737] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:10.807593 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a994cc-38c5-4efa-a156-49216a04088c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:10.814053 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb60da-506c-40c2-9e7d-07502659f8d4 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:10.814309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb60da-506c-40c2-9e7d-07502659f8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:10.814533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb60da-506c-40c2-9e7d-07502659f8d4 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:10.816028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 368/738] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:12:10.822729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f33fa3-4580-453b-b2fb-81fc22570de9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:10.823005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f33fa3-4580-453b-b2fb-81fc22570de9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:10.823277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f33fa3-4580-453b-b2fb-81fc22570de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:10.842568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-95f33fa3-4580-453b-b2fb-81fc22570de9 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:10.843760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-95f33fa3-4580-453b-b2fb-81fc22570de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:10.902140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:10.931424 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 369/739] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:10 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:12:10.932850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e4eec-694a-47dd-bd5e-0c730a4abb44 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:10.933136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e4eec-694a-47dd-bd5e-0c730a4abb44 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:10.933407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e4eec-694a-47dd-bd5e-0c730a4abb44 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:10.934681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 370/740] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:10.935829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190f19b-1d0d-417c-8527-c4bb78cb91a7 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:10.936130 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a994cc-38c5-4efa-a156-49216a04088c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:10.936418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190f19b-1d0d-417c-8527-c4bb78cb91a7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:10.936870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190f19b-1d0d-417c-8527-c4bb78cb91a7 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:10.938421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 371/741] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:10.941658 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e34ac-38de-419f-b340-b102a0320efe None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:10.942165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e34ac-38de-419f-b340-b102a0320efe None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:10.942637 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e34ac-38de-419f-b340-b102a0320efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:10.952016 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:10.961630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-519e34ac-38de-419f-b340-b102a0320efe None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:10.963039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-519e34ac-38de-419f-b340-b102a0320efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:10.979940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e77b29-c042-4796-8ba4-747dc387c36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:10.981455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e77b29-c042-4796-8ba4-747dc387c36d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:10.981912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e77b29-c042-4796-8ba4-747dc387c36d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:10.982379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e77b29-c042-4796-8ba4-747dc387c36d None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:10.983241 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e77b29-c042-4796-8ba4-747dc387c36d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:10.983763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e77b29-c042-4796-8ba4-747dc387c36d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:10.987522 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e77b29-c042-4796-8ba4-747dc387c36d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:11.003192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 371/742] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:11.009993 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cb883-46b8-4aa4-8588-e4037b83500d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:11.010629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cb883-46b8-4aa4-8588-e4037b83500d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:11.010911 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cb883-46b8-4aa4-8588-e4037b83500d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:11.031552 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-708cb883-46b8-4aa4-8588-e4037b83500d None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:11.032796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-708cb883-46b8-4aa4-8588-e4037b83500d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:11.056684 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 372/743] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:10 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:11.057610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e34ac-38de-419f-b340-b102a0320efe None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:11.154346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 372/744] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:11 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:11.204694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cb883-46b8-4aa4-8588-e4037b83500d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:11.247030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e34ac-38de-419f-b340-b102a0320efe None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:11.274208 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:11.334084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46738ec6-362b-4e32-a629-a3dfe0f3f4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:11.335247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46738ec6-362b-4e32-a629-a3dfe0f3f4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:11.335532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46738ec6-362b-4e32-a629-a3dfe0f3f4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:11.335813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46738ec6-362b-4e32-a629-a3dfe0f3f4a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:11.336530 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46738ec6-362b-4e32-a629-a3dfe0f3f4a7 None admin] RBAC: Adding query filter params (role.id=97ece22f2e264e0e857d5107325a85d9, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=35d0b95b22bc4117957cbc3afa5547a4) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:11.336860 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46738ec6-362b-4e32-a629-a3dfe0f3f4a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:11.338476 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46738ec6-362b-4e32-a629-a3dfe0f3f4a7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:11.344559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 373/745] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:12:11 2022] GET /identity/v3/role_assignments?user.id=35d0b95b22bc4117957cbc3afa5547a4&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 260 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:11.349061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cb883-46b8-4aa4-8588-e4037b83500d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:11.357054 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:11.390204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46738ec6-362b-4e32-a629-a3dfe0f3f4a7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:11.407041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137f9b5-205f-49c3-b2a3-f0b0c051db75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:11.407713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137f9b5-205f-49c3-b2a3-f0b0c051db75 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:11.407991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137f9b5-205f-49c3-b2a3-f0b0c051db75 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:11.408313 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137f9b5-205f-49c3-b2a3-f0b0c051db75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:11.422240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137f9b5-205f-49c3-b2a3-f0b0c051db75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:11.427915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-1137f9b5-205f-49c3-b2a3-f0b0c051db75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:11.427915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:11.427915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:11.427915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:11.427915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:11.427915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:11.427915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:11.427915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:11.427915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:11.427915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:11.427915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:11.427915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:11.427915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:11.427915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:11.427915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:11.427915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:11.429037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:11.429037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:11.429037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:11.429037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:11.429037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:11.429037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:11.429037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:11.429037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:11.429037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:11.429037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:11.429037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:11.429037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:11.429037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:11.429037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:11.429037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:11.429037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:11.429876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:11.429876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:11.429876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:11.429876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:11.429876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:11.429876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:11.429876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:11.429876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:11.429876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:11.429876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:11.429876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:11.429876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:11.429876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 373/746] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:11.441706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137f9b5-205f-49c3-b2a3-f0b0c051db75 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:11.566031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46738ec6-362b-4e32-a629-a3dfe0f3f4a7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:11.568015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137f9b5-205f-49c3-b2a3-f0b0c051db75 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:11.603298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4159ca9-b0f5-4d32-b15e-f5d0e4a562a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:11.603550 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486711a-7bc0-46c2-800e-cc476f97a388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:11.604175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486711a-7bc0-46c2-800e-cc476f97a388 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:11.604311 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4159ca9-b0f5-4d32-b15e-f5d0e4a562a8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:11.604560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4159ca9-b0f5-4d32-b15e-f5d0e4a562a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:11.604874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4159ca9-b0f5-4d32-b15e-f5d0e4a562a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:11.605142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486711a-7bc0-46c2-800e-cc476f97a388 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:11.605532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4159ca9-b0f5-4d32-b15e-f5d0e4a562a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:11.605717 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486711a-7bc0-46c2-800e-cc476f97a388 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:11.605821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4159ca9-b0f5-4d32-b15e-f5d0e4a562a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:11.606520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486711a-7bc0-46c2-800e-cc476f97a388 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:11.607183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4159ca9-b0f5-4d32-b15e-f5d0e4a562a8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:11.608170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486711a-7bc0-46c2-800e-cc476f97a388 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:11.621312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 374/747] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:12:11 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:11.622425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d486711a-7bc0-46c2-800e-cc476f97a388 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:12:11.622425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:11.622425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:11.622425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:11.622425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:11.622425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:11.622425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:11.622425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:11.622425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:12:11.622425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:11.622425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:11.622425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:11.622425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:11.622425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:11.622425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:11.622425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:11.622425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:11.623568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:11.623568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:11.623568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:11.623568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:11.623568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:11.623568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:11.623568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:11.623568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:11.623568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:11.623568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:11.623568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:11.623568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:11.623568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:11.623568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:11.623568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:11.623568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:11.624389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:11.624389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:11.624389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:11.624389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:11.624389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:11.624389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:11.624389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:11.624389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:11.624389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:11.624389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:11.624389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:11.624389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:11.624389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:12:11.624389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:11.625201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4159ca9-b0f5-4d32-b15e-f5d0e4a562a8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:11.628400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 374/748] 10.222.0.107 () {56 vars in 1134 bytes} [Tue Aug 23 23:12:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:11.630240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486711a-7bc0-46c2-800e-cc476f97a388 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:11.668975 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:11.682121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:11.762941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486711a-7bc0-46c2-800e-cc476f97a388 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:11.767015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4159ca9-b0f5-4d32-b15e-f5d0e4a562a8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:11.803334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15faffe-ceb4-4c1c-91c8-dc9956282b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:11.804484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15faffe-ceb4-4c1c-91c8-dc9956282b03 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:11.804908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15faffe-ceb4-4c1c-91c8-dc9956282b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:11.805248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15faffe-ceb4-4c1c-91c8-dc9956282b03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:11.815109 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb705-f5d9-46a3-ba1b-f862008e41e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:11.816299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb705-f5d9-46a3-ba1b-f862008e41e5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:11.816560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15faffe-ceb4-4c1c-91c8-dc9956282b03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:11.816917 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb705-f5d9-46a3-ba1b-f862008e41e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:11.817386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb705-f5d9-46a3-ba1b-f862008e41e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:11.818026 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15faffe-ceb4-4c1c-91c8-dc9956282b03 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:11.832113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3eb705-f5d9-46a3-ba1b-f862008e41e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:11.838770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f15faffe-ceb4-4c1c-91c8-dc9956282b03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:11.838770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:11.838770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:11.838770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:11.838770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:11.838770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:11.838770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:11.838770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:11.838770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:11.838770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:11.838770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:11.838770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:11.838770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:11.838770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:11.838770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:11.838770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:11.839943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:11.839943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:11.839943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:11.839943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:11.839943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:11.839943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:11.839943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:11.839943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:11.839943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:11.839943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:11.839943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:11.839943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:11.839943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:11.839943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:11.839943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:11.839943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:11.839943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:11.841449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:11.841449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:11.841449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:11.841655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-fe3eb705-f5d9-46a3-ba1b-f862008e41e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:11.841655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:11.841655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:11.841655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:11.841655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:11.841655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:11.841655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:11.841655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:11.841655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:11.841655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:11.841655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:11.841655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:11.841655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:11.841655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:11.841655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:11.841655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:11.842572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:11.842572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:11.842572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:11.842572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:11.842572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:11.842572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:11.842572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:11.842572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:11.842572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:11.842572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:11.842572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:11.842572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:11.842572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:11.842572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:11.842572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:11.842572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:11.844190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:11.844190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:11.844190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:11.844190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:11.844190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:11.844190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:11.844190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:11.844190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:11.844190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:11.844190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:11.844190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:11.844190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:11.844190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 375/749] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:12:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:11.844919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb705-f5d9-46a3-ba1b-f862008e41e5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:11.852965 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 375/750] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:11.853758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15faffe-ceb4-4c1c-91c8-dc9956282b03 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:11.967129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:11.978425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:11.980475 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15faffe-ceb4-4c1c-91c8-dc9956282b03 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.012620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb705-f5d9-46a3-ba1b-f862008e41e5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.019892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26fa79-66f2-473d-90ae-23de47b309f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.020562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26fa79-66f2-473d-90ae-23de47b309f7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.020882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26fa79-66f2-473d-90ae-23de47b309f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.021151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26fa79-66f2-473d-90ae-23de47b309f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.021816 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26fa79-66f2-473d-90ae-23de47b309f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:12.022710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26fa79-66f2-473d-90ae-23de47b309f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:12.024607 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26fa79-66f2-473d-90ae-23de47b309f7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:12.033991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 376/751] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:11 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:12.034843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26fa79-66f2-473d-90ae-23de47b309f7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.052113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd876fdd-6f5f-4ac2-9bcd-9bf83b3f2d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.053178 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd876fdd-6f5f-4ac2-9bcd-9bf83b3f2d46 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.054061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd876fdd-6f5f-4ac2-9bcd-9bf83b3f2d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.055081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd876fdd-6f5f-4ac2-9bcd-9bf83b3f2d46 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.055842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd876fdd-6f5f-4ac2-9bcd-9bf83b3f2d46 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:12.056393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd876fdd-6f5f-4ac2-9bcd-9bf83b3f2d46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:12.058212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd876fdd-6f5f-4ac2-9bcd-9bf83b3f2d46 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:12.064986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 376/752] 10.222.0.107 () {56 vars in 1129 bytes} [Tue Aug 23 23:12:11 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:12.065908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd876fdd-6f5f-4ac2-9bcd-9bf83b3f2d46 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.149240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26fa79-66f2-473d-90ae-23de47b309f7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.185710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37831722-c47c-42f5-ae09-bfbf7385e539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.186426 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37831722-c47c-42f5-ae09-bfbf7385e539 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.186764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37831722-c47c-42f5-ae09-bfbf7385e539 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.187116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37831722-c47c-42f5-ae09-bfbf7385e539 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.187824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37831722-c47c-42f5-ae09-bfbf7385e539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:12.188188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37831722-c47c-42f5-ae09-bfbf7385e539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:12.189666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37831722-c47c-42f5-ae09-bfbf7385e539 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:12.196954 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd876fdd-6f5f-4ac2-9bcd-9bf83b3f2d46 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.202836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 377/753] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:12.208246 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37831722-c47c-42f5-ae09-bfbf7385e539 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.224568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:12.235149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64528fab-63a1-4f52-bfd4-dede3f07e35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.235791 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64528fab-63a1-4f52-bfd4-dede3f07e35b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.236076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64528fab-63a1-4f52-bfd4-dede3f07e35b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.236342 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64528fab-63a1-4f52-bfd4-dede3f07e35b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.247063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64528fab-63a1-4f52-bfd4-dede3f07e35b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:12.248525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64528fab-63a1-4f52-bfd4-dede3f07e35b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:12.257456 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:12.265403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-64528fab-63a1-4f52-bfd4-dede3f07e35b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:12.265403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:12.265403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:12.265403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:12.265403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:12.265403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:12.265403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:12.265403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:12.265403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:12.265403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:12.265403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:12.265403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:12.265403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:12.265403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:12.265403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:12.265403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:12.266564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:12.266564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:12.266564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:12.266564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:12.266564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:12.266564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:12.266564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:12.266564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:12.266564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:12.266564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:12.266564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:12.266564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:12.266564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:12.266564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:12.266564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:12.266564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:12.266564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:12.267458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:12.267458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:12.267458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:12.269165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 377/754] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:12.270117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64528fab-63a1-4f52-bfd4-dede3f07e35b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.322721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37831722-c47c-42f5-ae09-bfbf7385e539 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.361948 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77d478-17c7-45ab-b1ad-cebff7688cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.362494 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77d478-17c7-45ab-b1ad-cebff7688cca None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.362765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77d478-17c7-45ab-b1ad-cebff7688cca None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.363030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77d478-17c7-45ab-b1ad-cebff7688cca None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.363850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77d478-17c7-45ab-b1ad-cebff7688cca None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:12.364006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77d478-17c7-45ab-b1ad-cebff7688cca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:12.365414 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77d478-17c7-45ab-b1ad-cebff7688cca None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:12.376335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 378/755] 10.222.0.107 () {56 vars in 1129 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:12.377289 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77d478-17c7-45ab-b1ad-cebff7688cca None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.385322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64528fab-63a1-4f52-bfd4-dede3f07e35b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.422452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee29cb-1e8b-4da8-a2e6-7ca7aa83e14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.423339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee29cb-1e8b-4da8-a2e6-7ca7aa83e14d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.423773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee29cb-1e8b-4da8-a2e6-7ca7aa83e14d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.424204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee29cb-1e8b-4da8-a2e6-7ca7aa83e14d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.433608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee29cb-1e8b-4da8-a2e6-7ca7aa83e14d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:12.435311 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee29cb-1e8b-4da8-a2e6-7ca7aa83e14d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:12.447614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e9ee29cb-1e8b-4da8-a2e6-7ca7aa83e14d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:12:12.447614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:12.447614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:12.447614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:12.447614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:12.447614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:12.447614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:12.447614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:12.447614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:12.447614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:12.447614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:12.447614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:12.447614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:12.447614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:12.447614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:12.447614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:12.449348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:12.449348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:12.449348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:12.449348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:12.449348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:12.449348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:12.449348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:12.449348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:12.449348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:12.449348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:12.449348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:12.449348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:12.449348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:12.449348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:12.449348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:12.449348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:12.449348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:12.449348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:12.451303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:12.451303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:12.451303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:12.451303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:12.451303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:12.451303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:12.451303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:12.451303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:12.451303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:12:12.451303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:12.453313 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 378/756] 10.222.0.107 () {56 vars in 1098 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:12.454314 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee29cb-1e8b-4da8-a2e6-7ca7aa83e14d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.491621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:12.497601 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77d478-17c7-45ab-b1ad-cebff7688cca None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.523711 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:12.539776 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92310c4c-2315-49bb-8495-e0eef57e3f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.540440 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92310c4c-2315-49bb-8495-e0eef57e3f00 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.540771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92310c4c-2315-49bb-8495-e0eef57e3f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.541089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92310c4c-2315-49bb-8495-e0eef57e3f00 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.541800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92310c4c-2315-49bb-8495-e0eef57e3f00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:12.542108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92310c4c-2315-49bb-8495-e0eef57e3f00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:12.543982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92310c4c-2315-49bb-8495-e0eef57e3f00 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:12.558863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 379/757] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:12.559286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92310c4c-2315-49bb-8495-e0eef57e3f00 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.573073 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee29cb-1e8b-4da8-a2e6-7ca7aa83e14d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.609699 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0885043-4883-4188-b59f-4f2cd8357247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.610679 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0885043-4883-4188-b59f-4f2cd8357247 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.611163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0885043-4883-4188-b59f-4f2cd8357247 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.611637 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0885043-4883-4188-b59f-4f2cd8357247 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.612565 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0885043-4883-4188-b59f-4f2cd8357247 None admin] RBAC: Adding query filter params (interface=public, service_id=9e670110da6f403ebf319adbf8e9a4e2, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:12.613100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0885043-4883-4188-b59f-4f2cd8357247 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:12.614668 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0885043-4883-4188-b59f-4f2cd8357247 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:12.623607 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 379/758] 10.222.0.107 () {56 vars in 1256 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/endpoints?service_id=9e670110da6f403ebf319adbf8e9a4e2&interface=public®ion_id=RegionOne => generated 195 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:12.624756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0885043-4883-4188-b59f-4f2cd8357247 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.686453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92310c4c-2315-49bb-8495-e0eef57e3f00 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.724199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16efd2-e378-4c6d-921b-5a6a884e2927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.724873 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16efd2-e378-4c6d-921b-5a6a884e2927 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.725391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16efd2-e378-4c6d-921b-5a6a884e2927 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.726185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16efd2-e378-4c6d-921b-5a6a884e2927 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.726943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16efd2-e378-4c6d-921b-5a6a884e2927 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:12.727479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16efd2-e378-4c6d-921b-5a6a884e2927 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:12.728783 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16efd2-e378-4c6d-921b-5a6a884e2927 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:12.731781 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:12.737636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0885043-4883-4188-b59f-4f2cd8357247 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.749887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 380/759] 10.222.0.107 () {56 vars in 1138 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:12.750824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16efd2-e378-4c6d-921b-5a6a884e2927 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.762900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:12.775211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5910f6d-1712-45b3-b806-abc7b75fb9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.776175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5910f6d-1712-45b3-b806-abc7b75fb9dc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.776743 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5910f6d-1712-45b3-b806-abc7b75fb9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.777236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5910f6d-1712-45b3-b806-abc7b75fb9dc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.785766 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5910f6d-1712-45b3-b806-abc7b75fb9dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:12.787487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5910f6d-1712-45b3-b806-abc7b75fb9dc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:12.800270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e5910f6d-1712-45b3-b806-abc7b75fb9dc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:12:12.800270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:12.800270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:12.800270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:12.800270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:12.800270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:12.800270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:12.800270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:12.800270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:12.800270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:12.800270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:12.800270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:12.800270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:12.800270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:12.800270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:12.800270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:12.801292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:12.801292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:12.801292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:12.801292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:12.801292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:12.801292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:12.801292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:12.801292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:12.801292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:12.801292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:12.801292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:12.801292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:12.801292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:12.801292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:12.801292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:12.801292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:12.801292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:12.801292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:12.802240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:12.802240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:12.802240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:12.802240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:12.802240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:12.802240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:12.802240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:12.802240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:12.802240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:12:12.802240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:12.805876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 380/760] 10.222.0.107 () {56 vars in 1122 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:12.806902 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5910f6d-1712-45b3-b806-abc7b75fb9dc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.864627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16efd2-e378-4c6d-921b-5a6a884e2927 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.904914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d014b11-b73f-4998-b1b4-ac22af693068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.905567 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d014b11-b73f-4998-b1b4-ac22af693068 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.905842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d014b11-b73f-4998-b1b4-ac22af693068 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.906110 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d014b11-b73f-4998-b1b4-ac22af693068 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.906849 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d014b11-b73f-4998-b1b4-ac22af693068 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:12.908216 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d014b11-b73f-4998-b1b4-ac22af693068 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:12.914571 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 381/761] 10.222.0.107 () {56 vars in 1092 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/services => generated 776 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:12.915113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d014b11-b73f-4998-b1b4-ac22af693068 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:12.937415 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5910f6d-1712-45b3-b806-abc7b75fb9dc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:12.991712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891cd75-e1cc-42c0-bcbe-b6d2b0173ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:12.993855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891cd75-e1cc-42c0-bcbe-b6d2b0173ffd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:12.993855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891cd75-e1cc-42c0-bcbe-b6d2b0173ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:12.993855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891cd75-e1cc-42c0-bcbe-b6d2b0173ffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:12.999532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:13.011555 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891cd75-e1cc-42c0-bcbe-b6d2b0173ffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:13.013403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891cd75-e1cc-42c0-bcbe-b6d2b0173ffd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:13.033377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8891cd75-e1cc-42c0-bcbe-b6d2b0173ffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:13.033377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:13.033377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:13.033377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:13.033377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:13.033377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:13.033377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:13.033377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:13.033377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:13.033377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:13.033377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:13.033377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:13.033377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:13.033377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:13.033377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:13.033377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:13.034614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:13.034614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:13.034614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:13.034614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:13.034614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:13.034614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:13.034614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:13.034614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:13.034614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:13.034614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:13.034614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:13.034614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:13.034614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:13.034614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:13.034614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:13.034614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:13.034614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:13.035537 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:13.035537 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:13.035537 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:13.037481 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 381/762] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:13.039588 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb59f15-f289-4800-8e2f-e409e8c831fa None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:13.040044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb59f15-f289-4800-8e2f-e409e8c831fa None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:13.040456 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb59f15-f289-4800-8e2f-e409e8c831fa None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:13.042341 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 382/763] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:13.043711 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb59f15-f289-4800-8e2f-e409e8c831fa None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:13.060259 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d014b11-b73f-4998-b1b4-ac22af693068 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:13.085376 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:13.107936 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a584c-a302-4c69-8fb9-2a9246fdb4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:13.108946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a584c-a302-4c69-8fb9-2a9246fdb4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:13.109443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a584c-a302-4c69-8fb9-2a9246fdb4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:13.109927 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a584c-a302-4c69-8fb9-2a9246fdb4b3 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:13.110866 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a584c-a302-4c69-8fb9-2a9246fdb4b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:13.111377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a584c-a302-4c69-8fb9-2a9246fdb4b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:13.112868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a584c-a302-4c69-8fb9-2a9246fdb4b3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:13.138495 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 382/764] 10.222.0.107 () {56 vars in 1154 bytes} [Tue Aug 23 23:12:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:13.138495 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2abf47-f77a-401b-aaaf-6ea241021d55 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:13.138495 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2abf47-f77a-401b-aaaf-6ea241021d55 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:13.138495 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2abf47-f77a-401b-aaaf-6ea241021d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:13.159295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4b2abf47-f77a-401b-aaaf-6ea241021d55 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:13.161491 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4b2abf47-f77a-401b-aaaf-6ea241021d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:13.179234 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb59f15-f289-4800-8e2f-e409e8c831fa None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:13.217406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ab79d-fea0-4765-8bf2-365184b9ddd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:13.218081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ab79d-fea0-4765-8bf2-365184b9ddd5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:13.218332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ab79d-fea0-4765-8bf2-365184b9ddd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:13.218608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ab79d-fea0-4765-8bf2-365184b9ddd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:13.219309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ab79d-fea0-4765-8bf2-365184b9ddd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:13.219613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ab79d-fea0-4765-8bf2-365184b9ddd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:13.221151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ab79d-fea0-4765-8bf2-365184b9ddd5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:13.235150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 383/765] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:13.235934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ab79d-fea0-4765-8bf2-365184b9ddd5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:13.264877 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 383/766] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:13 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:13.266161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2abf47-f77a-401b-aaaf-6ea241021d55 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:13.318929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:13.344440 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:13.351792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ab79d-fea0-4765-8bf2-365184b9ddd5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:13.381064 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2abf47-f77a-401b-aaaf-6ea241021d55 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:13.389765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d9166-8172-42ef-adc0-ae6386317fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:13.390814 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d9166-8172-42ef-adc0-ae6386317fcc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:13.391164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d9166-8172-42ef-adc0-ae6386317fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:13.391540 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d9166-8172-42ef-adc0-ae6386317fcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:13.421526 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e9ea4-8013-4f69-ae6f-3bee5bb3e652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:13.422466 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e9ea4-8013-4f69-ae6f-3bee5bb3e652 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:13.422945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e9ea4-8013-4f69-ae6f-3bee5bb3e652 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:13.423395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e9ea4-8013-4f69-ae6f-3bee5bb3e652 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:13.432442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e9ea4-8013-4f69-ae6f-3bee5bb3e652 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:13.434373 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e9ea4-8013-4f69-ae6f-3bee5bb3e652 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:13.447173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-193e9ea4-8013-4f69-ae6f-3bee5bb3e652 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:13.447173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:13.447173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:13.447173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:13.447173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:13.447173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:13.447173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:13.447173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:13.447173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:13.447173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:13.447173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:13.447173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:13.447173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:13.447173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:13.447173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:13.448108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:13.448108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:13.448108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:13.448108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:13.448108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:13.448108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:13.448108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:13.448108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:13.448108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:13.448108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:13.448108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:13.448108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:13.448108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:13.448108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:13.448108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:13.448108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:13.448108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:13.449014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:13.449014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:13.449014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:13.449014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:13.449014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:13.449014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:13.449014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:13.449014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:13.451462 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 384/767] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:13.457855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e9ea4-8013-4f69-ae6f-3bee5bb3e652 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:13.471513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d9166-8172-42ef-adc0-ae6386317fcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:13.473157 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d9166-8172-42ef-adc0-ae6386317fcc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:13.577182 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:13.581187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 384/768] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:12:13 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:12:13.588838 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d9166-8172-42ef-adc0-ae6386317fcc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:13.643922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e9ea4-8013-4f69-ae6f-3bee5bb3e652 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:13.653361 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:13.685102 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837d10f-7efc-4386-ac40-afc5df3b8761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:13.685975 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837d10f-7efc-4386-ac40-afc5df3b8761 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:13.686251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837d10f-7efc-4386-ac40-afc5df3b8761 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:13.686519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837d10f-7efc-4386-ac40-afc5df3b8761 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:13.687207 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837d10f-7efc-4386-ac40-afc5df3b8761 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:13.687506 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837d10f-7efc-4386-ac40-afc5df3b8761 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:13.689660 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837d10f-7efc-4386-ac40-afc5df3b8761 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:13.701874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d9166-8172-42ef-adc0-ae6386317fcc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:13.705004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 385/769] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:13.706265 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874e9ab-156a-4efe-bde6-b4d0b8db4271 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:13.706548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874e9ab-156a-4efe-bde6-b4d0b8db4271 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:13.706817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874e9ab-156a-4efe-bde6-b4d0b8db4271 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:13.712001 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 386/770] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:13.712001 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874e9ab-156a-4efe-bde6-b4d0b8db4271 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:13.744919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532283ca-a6e9-45b2-87f2-0c42a22a9de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:13.745523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532283ca-a6e9-45b2-87f2-0c42a22a9de4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:13.745806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532283ca-a6e9-45b2-87f2-0c42a22a9de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:13.746079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532283ca-a6e9-45b2-87f2-0c42a22a9de4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:13.757731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532283ca-a6e9-45b2-87f2-0c42a22a9de4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:13.759199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532283ca-a6e9-45b2-87f2-0c42a22a9de4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:13.775335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-532283ca-a6e9-45b2-87f2-0c42a22a9de4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:13.775335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:13.775335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:13.775335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:13.775335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:13.775335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:13.775335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:13.775335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:13.775335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:13.775335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:13.775335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:13.775335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:13.775335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:13.775335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:13.775335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:13.775335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:13.776325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:13.776325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:13.776325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:13.776325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:13.776325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:13.776325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:13.776325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:13.776325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:13.776325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:13.776325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:13.776325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:13.776325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:13.776325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:13.776325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:13.776325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:13.776325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:13.776325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:13.777792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:13.777792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:13.777792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:13.777792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 385/771] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:13.777792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532283ca-a6e9-45b2-87f2-0c42a22a9de4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:13.825676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874e9ab-156a-4efe-bde6-b4d0b8db4271 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:13.836456 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:13.864492 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae259704-c0f5-4dc6-8cb8-783928482757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:13.865171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae259704-c0f5-4dc6-8cb8-783928482757 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:13.865451 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae259704-c0f5-4dc6-8cb8-783928482757 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:13.865735 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae259704-c0f5-4dc6-8cb8-783928482757 None admin] PATH_INFO: `/v3/services/network` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:13.866890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae259704-c0f5-4dc6-8cb8-783928482757 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:13.868515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae259704-c0f5-4dc6-8cb8-783928482757 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:13.877563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ae259704-c0f5-4dc6-8cb8-783928482757 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:12:13.877563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:13.877563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:13.877563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:13.877563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:13.877563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:13.877563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:13.877563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:13.877563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:12:13.877563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:13.877563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:13.877563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:13.877563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:13.877563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:13.877563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:13.877563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:13.877563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:13.878803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:13.878803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:13.878803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:13.878803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:13.878803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:13.878803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:13.878803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:13.878803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:13.878803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:13.878803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:13.878803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:13.878803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:13.878803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:13.878803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:13.878803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:13.878803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:13.880123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:13.880123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:13.880123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:13.880123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:13.880123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:13.880123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:13.880123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:13.880123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:13.880123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:13.880123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:13.880123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:13.880123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:13.880123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:12:13.880123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:13.880123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 387/772] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:13 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:13.881911 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef062f42-bc4a-4ee4-94c1-69be20f7cbf8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:13.881911 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef062f42-bc4a-4ee4-94c1-69be20f7cbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:13.881911 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef062f42-bc4a-4ee4-94c1-69be20f7cbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:13.909062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ef062f42-bc4a-4ee4-94c1-69be20f7cbf8 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:13.910597 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ef062f42-bc4a-4ee4-94c1-69be20f7cbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:13.910971 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532283ca-a6e9-45b2-87f2-0c42a22a9de4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:13.944881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:13.971249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f3c4f-41ec-4756-a14f-f65da91b7d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:13.972043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f3c4f-41ec-4756-a14f-f65da91b7d0f None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:13.972419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f3c4f-41ec-4756-a14f-f65da91b7d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:13.972736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f3c4f-41ec-4756-a14f-f65da91b7d0f None admin] PATH_INFO: `/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/2f985626d8af4f3089e72998fad98b47/roles/97ece22f2e264e0e857d5107325a85d9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:13.975072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f3c4f-41ec-4756-a14f-f65da91b7d0f None admin] RBAC: Authorizing `identity:create_grant(project_id=f7cdd07c79614516be35aa2d82ec6a3b, user_id=2f985626d8af4f3089e72998fad98b47, role_id=97ece22f2e264e0e857d5107325a85d9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:13.976622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f3c4f-41ec-4756-a14f-f65da91b7d0f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:14.008650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 386/773] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:12:13 2022] PUT /identity/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/2f985626d8af4f3089e72998fad98b47/roles/97ece22f2e264e0e857d5107325a85d9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:12:14.008650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f3c4f-41ec-4756-a14f-f65da91b7d0f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:14.019666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 388/774] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:13 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:14.020729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef062f42-bc4a-4ee4-94c1-69be20f7cbf8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:14.215009 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef062f42-bc4a-4ee4-94c1-69be20f7cbf8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:14.215214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f3c4f-41ec-4756-a14f-f65da91b7d0f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:14.227501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:14.264618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659dee8-7ff8-44ca-8b3c-a011f18c19c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:14.265397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bb8fc-6c79-4ad7-92a2-de0950e8b18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:14.265662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659dee8-7ff8-44ca-8b3c-a011f18c19c1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:14.266083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659dee8-7ff8-44ca-8b3c-a011f18c19c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:14.266197 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bb8fc-6c79-4ad7-92a2-de0950e8b18d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:14.266516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bb8fc-6c79-4ad7-92a2-de0950e8b18d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:14.266747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659dee8-7ff8-44ca-8b3c-a011f18c19c1 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:14.266904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bb8fc-6c79-4ad7-92a2-de0950e8b18d None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:14.267608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bb8fc-6c79-4ad7-92a2-de0950e8b18d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:14.267796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659dee8-7ff8-44ca-8b3c-a011f18c19c1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:14.268038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bb8fc-6c79-4ad7-92a2-de0950e8b18d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:14.268393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659dee8-7ff8-44ca-8b3c-a011f18c19c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:14.270345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bb8fc-6c79-4ad7-92a2-de0950e8b18d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:14.272212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659dee8-7ff8-44ca-8b3c-a011f18c19c1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:14.278151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 389/775] 10.222.0.107 () {56 vars in 1117 bytes} [Tue Aug 23 23:12:14 2022] GET /identity/v3/services?name=network => generated 125 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:14.284094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659dee8-7ff8-44ca-8b3c-a011f18c19c1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:14.285996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 387/776] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:14.291655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bb8fc-6c79-4ad7-92a2-de0950e8b18d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:14.326589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:14.424586 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659dee8-7ff8-44ca-8b3c-a011f18c19c1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:14.427356 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bb8fc-6c79-4ad7-92a2-de0950e8b18d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:14.461255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bbafe-a4c7-4738-8850-df74caf4d5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:14.461876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bbafe-a4c7-4738-8850-df74caf4d5ff None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:14.462148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bbafe-a4c7-4738-8850-df74caf4d5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:14.462423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bbafe-a4c7-4738-8850-df74caf4d5ff None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:14.463065 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bbafe-a4c7-4738-8850-df74caf4d5ff None admin] RBAC: Adding query filter params (type=network) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:14.463392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bbafe-a4c7-4738-8850-df74caf4d5ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:14.465074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bbafe-a4c7-4738-8850-df74caf4d5ff None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:14.466825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74c34c-9224-40d6-876a-0a8e81ce0c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:14.467717 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74c34c-9224-40d6-876a-0a8e81ce0c73 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:14.468138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74c34c-9224-40d6-876a-0a8e81ce0c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:14.468553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74c34c-9224-40d6-876a-0a8e81ce0c73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:14.471158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 390/777] 10.222.0.107 () {56 vars in 1117 bytes} [Tue Aug 23 23:12:14 2022] GET /identity/v3/services?type=network => generated 352 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:14.472352 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bbafe-a4c7-4738-8850-df74caf4d5ff None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:14.478052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74c34c-9224-40d6-876a-0a8e81ce0c73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:14.479697 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74c34c-9224-40d6-876a-0a8e81ce0c73 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:14.492760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-5b74c34c-9224-40d6-876a-0a8e81ce0c73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:14.492760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:14.492760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:14.492760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:14.492760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:14.492760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:14.492760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:14.492760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:14.492760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:14.492760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:14.492760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:14.492760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:14.492760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:14.492760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:14.492760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:14.493901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:14.493901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:14.493901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:14.493901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:14.493901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:14.493901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:14.493901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:14.493901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:14.493901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:14.493901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:14.493901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:14.493901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:14.493901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:14.493901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:14.493901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:14.493901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:14.493901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:14.494986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:14.494986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:14.494986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:14.494986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:14.494986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:14.494986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:14.494986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:14.494986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:14.497115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 388/778] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:14.498059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74c34c-9224-40d6-876a-0a8e81ce0c73 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:14.530812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:14.575408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:14.589582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bbafe-a4c7-4738-8850-df74caf4d5ff None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:14.613935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74c34c-9224-40d6-876a-0a8e81ce0c73 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:14.639166 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cd9d0-1444-4a64-b179-0556159b21d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:14.640307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cd9d0-1444-4a64-b179-0556159b21d3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:14.640719 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cd9d0-1444-4a64-b179-0556159b21d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:14.641226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cd9d0-1444-4a64-b179-0556159b21d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:14.651709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b7ea6-4a12-48dd-869d-a10b57f38938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:14.652683 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b7ea6-4a12-48dd-869d-a10b57f38938 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:14.653157 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b7ea6-4a12-48dd-869d-a10b57f38938 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:14.653562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b7ea6-4a12-48dd-869d-a10b57f38938 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:14.653959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cd9d0-1444-4a64-b179-0556159b21d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:14.654491 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b7ea6-4a12-48dd-869d-a10b57f38938 None admin] RBAC: Adding query filter params (interface=public, service_id=503a1f3ed884433c9e8415d55e0163b3, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:14.654894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b7ea6-4a12-48dd-869d-a10b57f38938 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:14.656367 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b7ea6-4a12-48dd-869d-a10b57f38938 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:14.660107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-787cd9d0-1444-4a64-b179-0556159b21d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:14.660107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:14.660107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:14.660107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:14.660107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:14.660107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:14.660107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:14.660107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:14.660107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:14.660107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:14.660107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:14.660107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:14.660107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:14.660107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:14.660107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:14.660107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:14.661180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:14.661180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:14.661180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:14.661180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:14.661180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:14.661180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:14.661180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:14.661180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:14.661180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:14.661180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:14.661180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:14.661180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:14.661180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:14.661180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:14.661180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:14.661180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:14.662031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:14.662031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:14.662031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:14.662031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:14.662031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:14.662031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:14.662031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:14.662031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:14.662031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:14.662031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:14.662031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:14.662031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:14.662670 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 391/779] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:14.664035 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cd9d0-1444-4a64-b179-0556159b21d3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:14.666583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 389/780] 10.222.0.107 () {56 vars in 1256 bytes} [Tue Aug 23 23:12:14 2022] GET /identity/v3/endpoints?service_id=503a1f3ed884433c9e8415d55e0163b3&interface=public®ion_id=RegionOne => generated 195 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:14.668831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b7ea6-4a12-48dd-869d-a10b57f38938 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:14.771720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:14.781941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b7ea6-4a12-48dd-869d-a10b57f38938 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:14.786923 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cd9d0-1444-4a64-b179-0556159b21d3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:14.830418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a09c7-28a0-4b55-a16e-4199e57d6eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:14.831127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a09c7-28a0-4b55-a16e-4199e57d6eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:14.831514 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a09c7-28a0-4b55-a16e-4199e57d6eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:14.831814 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a09c7-28a0-4b55-a16e-4199e57d6eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:14.832549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a09c7-28a0-4b55-a16e-4199e57d6eb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:14.832995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a09c7-28a0-4b55-a16e-4199e57d6eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:14.834222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19881cdf-6924-4947-8bc2-9c3fcafedc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:14.834535 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a09c7-28a0-4b55-a16e-4199e57d6eb9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:14.835468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19881cdf-6924-4947-8bc2-9c3fcafedc52 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:14.835923 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19881cdf-6924-4947-8bc2-9c3fcafedc52 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:14.836375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19881cdf-6924-4947-8bc2-9c3fcafedc52 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:14.837268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19881cdf-6924-4947-8bc2-9c3fcafedc52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:14.837778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19881cdf-6924-4947-8bc2-9c3fcafedc52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:14.839429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19881cdf-6924-4947-8bc2-9c3fcafedc52 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:14.845286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 390/781] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:12:14 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:14.846227 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a09c7-28a0-4b55-a16e-4199e57d6eb9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:14.861520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 392/782] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:14.862454 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19881cdf-6924-4947-8bc2-9c3fcafedc52 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:14.878782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:14.959944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a09c7-28a0-4b55-a16e-4199e57d6eb9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:14.988395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19881cdf-6924-4947-8bc2-9c3fcafedc52 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:14.996131 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289555e-e041-423e-b9f9-12c3c1f75ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:14.997211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289555e-e041-423e-b9f9-12c3c1f75ccd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:14.997924 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289555e-e041-423e-b9f9-12c3c1f75ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:14.998296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289555e-e041-423e-b9f9-12c3c1f75ccd None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:14.999035 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289555e-e041-423e-b9f9-12c3c1f75ccd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:15.000742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289555e-e041-423e-b9f9-12c3c1f75ccd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:15.008452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 391/783] 10.222.0.107 () {56 vars in 1092 bytes} [Tue Aug 23 23:12:14 2022] GET /identity/v3/services => generated 776 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:15.008452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289555e-e041-423e-b9f9-12c3c1f75ccd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:15.030232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:15.039160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca5eec-6bc0-4787-aabd-76831e0175c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:15.040125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca5eec-6bc0-4787-aabd-76831e0175c3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:15.040553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca5eec-6bc0-4787-aabd-76831e0175c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:15.041021 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca5eec-6bc0-4787-aabd-76831e0175c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:15.053976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca5eec-6bc0-4787-aabd-76831e0175c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:15.055880 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca5eec-6bc0-4787-aabd-76831e0175c3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:15.074214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-54ca5eec-6bc0-4787-aabd-76831e0175c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:15.074214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:15.074214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:15.074214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:15.074214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:15.074214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:15.074214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:15.074214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:15.074214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:15.074214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:15.074214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:15.074214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:15.074214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:15.074214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:15.074214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:15.074214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:15.075444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:15.075444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:15.075444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:15.075444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:15.075444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:15.075444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:15.075444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:15.075444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:15.075444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:15.075444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:15.075444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:15.075444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:15.075444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:15.075444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:15.075444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:15.075444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:15.075444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:15.076380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:15.076380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:15.076380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:15.078664 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 393/784] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:15.080421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0202c-6dd2-433f-910e-a098a5c19c39 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:15.080916 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0202c-6dd2-433f-910e-a098a5c19c39 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:15.081460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0202c-6dd2-433f-910e-a098a5c19c39 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:15.083416 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 394/785] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:15.085179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0202c-6dd2-433f-910e-a098a5c19c39 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:15.129277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289555e-e041-423e-b9f9-12c3c1f75ccd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:15.167425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:15.172362 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074b6c8-d481-4d03-b4ff-1f14407dd76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:15.172991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074b6c8-d481-4d03-b4ff-1f14407dd76b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:15.173421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074b6c8-d481-4d03-b4ff-1f14407dd76b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:15.173737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074b6c8-d481-4d03-b4ff-1f14407dd76b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:15.174464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074b6c8-d481-4d03-b4ff-1f14407dd76b None admin] RBAC: Adding query filter params (role.id=ee7f9512e7e745199ff5ed847343d11a, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=238ad0efedfd4cd89d99e2abebaeba63) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:15.174820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074b6c8-d481-4d03-b4ff-1f14407dd76b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:15.176294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074b6c8-d481-4d03-b4ff-1f14407dd76b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:15.183978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 392/786] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:12:15 2022] GET /identity/v3/role_assignments?user.id=238ad0efedfd4cd89d99e2abebaeba63&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=ee7f9512e7e745199ff5ed847343d11a => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:15.185569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438be42-913b-4b97-9c9c-f35ecac38b9f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:15.185849 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438be42-913b-4b97-9c9c-f35ecac38b9f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:15.186118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438be42-913b-4b97-9c9c-f35ecac38b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:15.209216 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7438be42-913b-4b97-9c9c-f35ecac38b9f None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:15.211397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7438be42-913b-4b97-9c9c-f35ecac38b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:15.233149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0202c-6dd2-433f-910e-a098a5c19c39 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:15.297096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c441800-401e-4d24-9e25-db6ba47e4195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:15.297635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c441800-401e-4d24-9e25-db6ba47e4195 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:15.299212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c441800-401e-4d24-9e25-db6ba47e4195 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:15.299500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c441800-401e-4d24-9e25-db6ba47e4195 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:15.300165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c441800-401e-4d24-9e25-db6ba47e4195 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:15.300467 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c441800-401e-4d24-9e25-db6ba47e4195 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:15.301895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c441800-401e-4d24-9e25-db6ba47e4195 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:15.330299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 393/787] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:15 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:15.330823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 395/788] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:15.337338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438be42-913b-4b97-9c9c-f35ecac38b9f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:15.357952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:15.459032 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438be42-913b-4b97-9c9c-f35ecac38b9f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:15.497251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bde703-8729-468a-ac80-ad696523ee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:15.497876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bde703-8729-468a-ac80-ad696523ee48 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:15.498150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bde703-8729-468a-ac80-ad696523ee48 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:15.498415 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bde703-8729-468a-ac80-ad696523ee48 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:15.505959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bde703-8729-468a-ac80-ad696523ee48 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:15.508178 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bde703-8729-468a-ac80-ad696523ee48 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:15.520523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-69bde703-8729-468a-ac80-ad696523ee48 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:12:15.520523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:15.520523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:15.520523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:15.520523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:15.520523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:15.520523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:15.520523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:15.520523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:15.520523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:15.520523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:15.520523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:15.520523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:15.520523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:15.520523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:15.520523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:15.521521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:15.521521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:15.521521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:15.521521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:15.521521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:15.521521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:15.521521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:15.521521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:15.521521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:15.521521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:15.521521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:15.521521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:15.521521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:15.521521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:15.521521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:15.521521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:15.521521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:15.521521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:15.523062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:15.523062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:15.523062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:15.523062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:15.523062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:15.523062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:15.523062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:15.523062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:15.523062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:12:15.523062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:15.523062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 394/789] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:15.529713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c441800-401e-4d24-9e25-db6ba47e4195 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:15.651116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c441800-401e-4d24-9e25-db6ba47e4195 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:15.671933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:15.674362 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bde703-8729-468a-ac80-ad696523ee48 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:15.713754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a3bbe-2bef-4c36-8cfd-7fa2152c5ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:15.714376 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a3bbe-2bef-4c36-8cfd-7fa2152c5ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:15.714650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a3bbe-2bef-4c36-8cfd-7fa2152c5ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:15.714918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a3bbe-2bef-4c36-8cfd-7fa2152c5ba5 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:15.715659 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a3bbe-2bef-4c36-8cfd-7fa2152c5ba5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:15.715957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a3bbe-2bef-4c36-8cfd-7fa2152c5ba5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:15.717422 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a3bbe-2bef-4c36-8cfd-7fa2152c5ba5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:15.744399 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 396/790] 10.222.0.107 () {56 vars in 1140 bytes} [Tue Aug 23 23:12:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:15.750727 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a3bbe-2bef-4c36-8cfd-7fa2152c5ba5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:15.845067 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:15.916553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bde703-8729-468a-ac80-ad696523ee48 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:15.963277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493abb0-f72f-4c6b-bc64-30b72ff91b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:15.963916 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493abb0-f72f-4c6b-bc64-30b72ff91b8c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:15.964305 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493abb0-f72f-4c6b-bc64-30b72ff91b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:15.964583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493abb0-f72f-4c6b-bc64-30b72ff91b8c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:15.965297 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493abb0-f72f-4c6b-bc64-30b72ff91b8c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:15.966702 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493abb0-f72f-4c6b-bc64-30b72ff91b8c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:15.976631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3493abb0-f72f-4c6b-bc64-30b72ff91b8c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:12:15.976631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:15.976631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:15.976631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:15.976631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:15.976631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:15.976631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:15.976631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:15.976631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:12:15.976631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:15.976631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:15.976631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:15.976631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:15.976631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:15.976631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:15.976631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:15.976631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:15.977655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:15.977655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:15.977655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:15.977655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:15.977655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:15.977655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:15.977655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:15.977655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:15.977655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:15.977655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:15.977655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:15.977655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:15.977655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:15.977655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:15.977655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:15.977655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:15.978515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:15.978515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:15.978515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:15.978515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:15.978515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:15.978515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:15.978515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:15.978515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:15.978515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:15.978515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:15.978515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:15.978515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:15.978515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:12:15.978515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:15.978515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 395/791] 10.222.0.107 () {56 vars in 1134 bytes} [Tue Aug 23 23:12:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:15.985729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493abb0-f72f-4c6b-bc64-30b72ff91b8c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:16.012746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a3bbe-2bef-4c36-8cfd-7fa2152c5ba5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:16.050867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c53297-44a9-44f4-9664-2c844f7c31fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:16.051499 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c53297-44a9-44f4-9664-2c844f7c31fc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:16.051776 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c53297-44a9-44f4-9664-2c844f7c31fc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:16.052045 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c53297-44a9-44f4-9664-2c844f7c31fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:16.063706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c53297-44a9-44f4-9664-2c844f7c31fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:16.065350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c53297-44a9-44f4-9664-2c844f7c31fc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:16.083308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f4c53297-44a9-44f4-9664-2c844f7c31fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:16.083308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:16.083308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:16.083308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:16.083308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:16.083308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:16.083308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:16.083308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:16.083308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:16.083308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:16.083308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:16.083308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:16.083308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:16.083308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:16.083308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:16.083308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:16.084318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:16.084318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:16.084318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:16.084318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:16.084318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:16.084318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:16.084318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:16.084318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:16.084318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:16.084318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:16.084318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:16.084318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:16.084318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:16.084318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:16.084318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:16.084318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:16.084318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:16.085946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:16.085946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:16.085946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:16.085946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 397/792] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:16.091239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c53297-44a9-44f4-9664-2c844f7c31fc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:16.164979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:16.207359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c53297-44a9-44f4-9664-2c844f7c31fc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:16.267148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567518fa-68f9-4273-b7b8-ed0c175da674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:16.267756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567518fa-68f9-4273-b7b8-ed0c175da674 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:16.268035 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567518fa-68f9-4273-b7b8-ed0c175da674 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:16.268302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567518fa-68f9-4273-b7b8-ed0c175da674 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:16.268881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493abb0-f72f-4c6b-bc64-30b72ff91b8c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:16.269003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567518fa-68f9-4273-b7b8-ed0c175da674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:16.269254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567518fa-68f9-4273-b7b8-ed0c175da674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:16.270780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567518fa-68f9-4273-b7b8-ed0c175da674 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:16.290471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 398/793] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:16.290471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cf33c-3be9-427f-8ebd-4f9ccf83778d None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:16.290471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cf33c-3be9-427f-8ebd-4f9ccf83778d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:16.290471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cf33c-3be9-427f-8ebd-4f9ccf83778d None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:16.290471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 399/794] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:16.296627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cf33c-3be9-427f-8ebd-4f9ccf83778d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:16.316111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e914f-db45-4e3f-9f5a-37e31c378df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:16.317040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e914f-db45-4e3f-9f5a-37e31c378df7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:16.317622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e914f-db45-4e3f-9f5a-37e31c378df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:16.318079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e914f-db45-4e3f-9f5a-37e31c378df7 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:16.319624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e914f-db45-4e3f-9f5a-37e31c378df7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:16.320110 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e914f-db45-4e3f-9f5a-37e31c378df7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:16.321858 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e914f-db45-4e3f-9f5a-37e31c378df7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:16.324352 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:16.328580 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 396/795] 10.222.0.107 () {56 vars in 1129 bytes} [Tue Aug 23 23:12:15 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:16.330114 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4f3a8-1739-42e9-adaa-4770ba24e78a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:16.330739 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4f3a8-1739-42e9-adaa-4770ba24e78a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:16.331735 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4f3a8-1739-42e9-adaa-4770ba24e78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:16.357349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b7e4f3a8-1739-42e9-adaa-4770ba24e78a None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:16.358581 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b7e4f3a8-1739-42e9-adaa-4770ba24e78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:16.401837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:16.414594 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cf33c-3be9-427f-8ebd-4f9ccf83778d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:16.452623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 397/796] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:16 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:16.452623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4f3a8-1739-42e9-adaa-4770ba24e78a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:16.460814 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5e8ce-0df3-488e-94fe-9f5d4fe2aa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:16.461798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5e8ce-0df3-488e-94fe-9f5d4fe2aa2f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:16.462297 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5e8ce-0df3-488e-94fe-9f5d4fe2aa2f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:16.462815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5e8ce-0df3-488e-94fe-9f5d4fe2aa2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:16.477742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5e8ce-0df3-488e-94fe-9f5d4fe2aa2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:16.479488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5e8ce-0df3-488e-94fe-9f5d4fe2aa2f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:16.498055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d2b5e8ce-0df3-488e-94fe-9f5d4fe2aa2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:16.498055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:16.498055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:16.498055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:16.498055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:16.498055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:16.498055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:16.498055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:16.498055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:16.498055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:16.498055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:16.498055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:16.498055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:16.498055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:16.498055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:16.499018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:16.499018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:16.499018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:16.499018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:16.499018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:16.499018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:16.499018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:16.499018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:16.499018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:16.499018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:16.499018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:16.499018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:16.499018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:16.499018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:16.499018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:16.499018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:16.499018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:16.499929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:16.499929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:16.499929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:16.499929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:16.499929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:16.499929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:16.499929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:16.499929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:16.508868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 400/797] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:16.510771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5e8ce-0df3-488e-94fe-9f5d4fe2aa2f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:16.567378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4f3a8-1739-42e9-adaa-4770ba24e78a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:16.602215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:16.610392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d9f39-e41f-4ff6-8276-42b01d83fbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:16.611211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d9f39-e41f-4ff6-8276-42b01d83fbbc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:16.611778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d9f39-e41f-4ff6-8276-42b01d83fbbc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:16.612189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d9f39-e41f-4ff6-8276-42b01d83fbbc None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:16.612983 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d9f39-e41f-4ff6-8276-42b01d83fbbc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:16.613411 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d9f39-e41f-4ff6-8276-42b01d83fbbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:16.614891 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d9f39-e41f-4ff6-8276-42b01d83fbbc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:16.622824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 398/798] 10.222.0.107 () {56 vars in 1129 bytes} [Tue Aug 23 23:12:16 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:16.628631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d9f39-e41f-4ff6-8276-42b01d83fbbc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:16.717988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5e8ce-0df3-488e-94fe-9f5d4fe2aa2f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:16.781848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a95fb-77b6-42a5-b616-35e0de515eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:16.782481 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a95fb-77b6-42a5-b616-35e0de515eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:16.782770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a95fb-77b6-42a5-b616-35e0de515eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:16.783046 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a95fb-77b6-42a5-b616-35e0de515eb8 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:16.783795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a95fb-77b6-42a5-b616-35e0de515eb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:16.784109 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a95fb-77b6-42a5-b616-35e0de515eb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:16.785622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a95fb-77b6-42a5-b616-35e0de515eb8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:16.802022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d9f39-e41f-4ff6-8276-42b01d83fbbc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:16.809181 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 401/799] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:16.820737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a95fb-77b6-42a5-b616-35e0de515eb8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:16.842986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:16.846409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3c735-10d9-42c4-940e-b0dbc122ab25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:16.847084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3c735-10d9-42c4-940e-b0dbc122ab25 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:16.847419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3c735-10d9-42c4-940e-b0dbc122ab25 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:16.848106 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3c735-10d9-42c4-940e-b0dbc122ab25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:16.849154 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3c735-10d9-42c4-940e-b0dbc122ab25 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:16.851307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3c735-10d9-42c4-940e-b0dbc122ab25 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:16.888795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 399/800] 10.222.0.107 () {60 vars in 1149 bytes} [Tue Aug 23 23:12:16 2022] POST /identity/v3/endpoints => generated 348 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:16.890910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3c735-10d9-42c4-940e-b0dbc122ab25 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:16.994082 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:17.015596 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a95fb-77b6-42a5-b616-35e0de515eb8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:17.075713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6280967-3e8b-4266-a520-b7e244a4abd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:17.076391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6280967-3e8b-4266-a520-b7e244a4abd4 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:17.076766 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6280967-3e8b-4266-a520-b7e244a4abd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:17.077037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6280967-3e8b-4266-a520-b7e244a4abd4 None admin] PATH_INFO: `/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/35d0b95b22bc4117957cbc3afa5547a4/roles/97ece22f2e264e0e857d5107325a85d9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:17.079818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6280967-3e8b-4266-a520-b7e244a4abd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7cdd07c79614516be35aa2d82ec6a3b, user_id=35d0b95b22bc4117957cbc3afa5547a4, role_id=97ece22f2e264e0e857d5107325a85d9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:17.082507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6280967-3e8b-4266-a520-b7e244a4abd4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:17.102755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3c735-10d9-42c4-940e-b0dbc122ab25 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:17.106541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 402/801] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:12:16 2022] PUT /identity/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/35d0b95b22bc4117957cbc3afa5547a4/roles/97ece22f2e264e0e857d5107325a85d9 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:12:17.160627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0744f-c0e8-471b-b039-494138a6edd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:17.161309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0744f-c0e8-471b-b039-494138a6edd2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:17.161582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0744f-c0e8-471b-b039-494138a6edd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:17.161851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0744f-c0e8-471b-b039-494138a6edd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:17.175501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0744f-c0e8-471b-b039-494138a6edd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:17.305881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4af0744f-c0e8-471b-b039-494138a6edd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:17.305881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:17.305881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:17.305881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:17.305881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:17.305881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:17.305881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:17.305881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:17.305881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:17.305881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:17.305881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:17.305881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:17.305881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:17.305881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:17.305881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:17.305881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:17.306882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:17.306882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:17.306882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:17.306882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:17.306882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:17.306882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:17.306882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:17.306882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:17.306882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:17.306882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:17.306882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:17.306882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:17.306882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:17.306882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:17.306882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:17.306882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:17.307732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:17.307732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:17.307732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:17.307732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:17.307732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:17.307732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:17.307732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:17.307732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:17.307732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:17.307732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:17.307732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:17.307732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:17.307732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 400/802] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:17.312832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6280967-3e8b-4266-a520-b7e244a4abd4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:17.329246 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bbdbc-bcf7-456a-82a3-af8e57db4ecd None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:17.329566 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bbdbc-bcf7-456a-82a3-af8e57db4ecd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:17.329790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bbdbc-bcf7-456a-82a3-af8e57db4ecd None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:17.331370 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 401/803] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:17.337540 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a2df1-298d-4318-9da6-e3081eb86b4f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:17.337825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a2df1-298d-4318-9da6-e3081eb86b4f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:17.338078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a2df1-298d-4318-9da6-e3081eb86b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:17.360317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-221a2df1-298d-4318-9da6-e3081eb86b4f None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:17.362075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-221a2df1-298d-4318-9da6-e3081eb86b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:17.416958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:17.459331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6280967-3e8b-4266-a520-b7e244a4abd4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:17.473589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 402/804] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:17 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:17.526220 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc2491-fc60-4570-a9de-4300e403ccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:17.526838 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc2491-fc60-4570-a9de-4300e403ccfd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:17.527163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc2491-fc60-4570-a9de-4300e403ccfd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:17.527435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc2491-fc60-4570-a9de-4300e403ccfd None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:17.528154 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc2491-fc60-4570-a9de-4300e403ccfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:17.528455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc2491-fc60-4570-a9de-4300e403ccfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:17.529909 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc2491-fc60-4570-a9de-4300e403ccfd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:17.542491 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 403/805] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:12:17 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:17.548154 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a2df1-298d-4318-9da6-e3081eb86b4f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:17.618857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:17.702227 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a2df1-298d-4318-9da6-e3081eb86b4f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:17.703450 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6896b75-0914-4414-9a33-f867994c410a None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:17.703737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6896b75-0914-4414-9a33-f867994c410a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:17.704013 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6896b75-0914-4414-9a33-f867994c410a None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:17.706633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 404/806] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:12:17.710934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ace96-0997-4d1e-aa0a-d7e655f3942a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:17.711215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ace96-0997-4d1e-aa0a-d7e655f3942a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:17.711486 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ace96-0997-4d1e-aa0a-d7e655f3942a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:17.740767 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d74ace96-0997-4d1e-aa0a-d7e655f3942a None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:17.744422 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d74ace96-0997-4d1e-aa0a-d7e655f3942a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:17.770439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952769d-a59d-4b3a-9f61-d40191e8ecbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:17.771090 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952769d-a59d-4b3a-9f61-d40191e8ecbd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:17.771369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952769d-a59d-4b3a-9f61-d40191e8ecbd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:17.771639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952769d-a59d-4b3a-9f61-d40191e8ecbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:17.783653 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952769d-a59d-4b3a-9f61-d40191e8ecbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:17.785279 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952769d-a59d-4b3a-9f61-d40191e8ecbd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:17.801061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-d952769d-a59d-4b3a-9f61-d40191e8ecbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:17.801061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:17.801061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:17.801061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:17.801061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:17.801061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:17.801061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:17.801061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:17.801061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:17.801061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:17.801061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:17.801061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:17.801061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:17.801061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:17.801061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:17.801061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:17.802074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:17.802074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:17.802074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:17.802074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:17.802074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:17.802074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:17.802074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:17.802074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:17.802074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:17.802074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:17.802074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:17.802074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:17.802074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:17.802074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:17.802074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:17.802074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:17.802074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:17.803013 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:17.803013 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:17.803013 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:17.803013 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 403/807] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:17.808731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952769d-a59d-4b3a-9f61-d40191e8ecbd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:17.860734 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 405/808] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:17 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:17.861861 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ace96-0997-4d1e-aa0a-d7e655f3942a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:17.941275 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:17.950646 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952769d-a59d-4b3a-9f61-d40191e8ecbd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:17.972236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:18.030948 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f9217-a475-4695-bfb4-6be5a397f955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:18.031569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f9217-a475-4695-bfb4-6be5a397f955 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:18.031845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f9217-a475-4695-bfb4-6be5a397f955 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:18.032118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f9217-a475-4695-bfb4-6be5a397f955 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:18.032806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f9217-a475-4695-bfb4-6be5a397f955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:18.033112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f9217-a475-4695-bfb4-6be5a397f955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:18.034488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f9217-a475-4695-bfb4-6be5a397f955 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:18.056162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ace96-0997-4d1e-aa0a-d7e655f3942a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:18.067392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 404/809] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:18.068322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f9217-a475-4695-bfb4-6be5a397f955 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:18.132234 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f49e54-f6f2-42f7-8a4d-71cd026f55eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:18.132921 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f49e54-f6f2-42f7-8a4d-71cd026f55eb None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:18.133221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f49e54-f6f2-42f7-8a4d-71cd026f55eb None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:18.133474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f49e54-f6f2-42f7-8a4d-71cd026f55eb None admin] PATH_INFO: `/v3/services/network` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:18.134068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f49e54-f6f2-42f7-8a4d-71cd026f55eb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:18.135433 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f49e54-f6f2-42f7-8a4d-71cd026f55eb None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:18.157267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a4f49e54-f6f2-42f7-8a4d-71cd026f55eb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:12:18.157267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:18.157267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:18.157267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:18.157267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:18.157267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:18.157267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:18.157267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:18.157267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:12:18.157267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:18.157267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:18.157267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:18.157267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:18.157267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:18.157267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:18.157267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:18.157267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:18.158309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:18.158309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:18.158309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:18.158309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:18.158309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:18.158309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:18.158309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:18.158309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:18.158309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:18.158309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:18.158309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:18.158309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:18.158309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:18.158309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:18.158309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:18.158309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:18.159167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:18.159167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:18.159167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:18.159167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:18.159167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:18.159167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:18.159167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:18.159167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:18.159167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:18.159167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:18.159167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:18.159167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:18.159167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:12:18.159167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:18.159167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 406/810] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:17 2022] GET /identity/v3/services/network => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:18.159952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f49e54-f6f2-42f7-8a4d-71cd026f55eb None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:18.223853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f9217-a475-4695-bfb4-6be5a397f955 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:18.259667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1aabfd-9fd5-45c2-bf44-81abed29b9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:18.260300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1aabfd-9fd5-45c2-bf44-81abed29b9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:18.260570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1aabfd-9fd5-45c2-bf44-81abed29b9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:18.260867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1aabfd-9fd5-45c2-bf44-81abed29b9d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:18.269602 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1aabfd-9fd5-45c2-bf44-81abed29b9d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:18.271382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1aabfd-9fd5-45c2-bf44-81abed29b9d1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:18.284842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3c1aabfd-9fd5-45c2-bf44-81abed29b9d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:12:18.284842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:18.284842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:18.284842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:18.284842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:18.284842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:18.284842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:18.284842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:18.284842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:18.284842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:18.284842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:18.284842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:18.284842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:18.284842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:18.284842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:18.284842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:18.285868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:18.285868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:18.285868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:18.285868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:18.285868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:18.285868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:18.285868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:18.285868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:18.285868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:18.285868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:18.285868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:18.285868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:18.285868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:18.285868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:18.285868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:18.285868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:18.285868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:18.285868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:18.286798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:18.286798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:18.286798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:18.286798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:18.286798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:18.286798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:18.286798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:18.286798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:18.286798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:12:18.286798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:18.291280 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 405/811] 10.222.0.107 () {56 vars in 1098 bytes} [Tue Aug 23 23:12:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:18.292175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1aabfd-9fd5-45c2-bf44-81abed29b9d1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:18.294006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f49e54-f6f2-42f7-8a4d-71cd026f55eb None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:18.307669 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:18.322719 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:18.337796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202dd708-bd95-4585-b17d-5984ce2cc950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:18.338901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dd708-bd95-4585-b17d-5984ce2cc950 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:18.339408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dd708-bd95-4585-b17d-5984ce2cc950 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:18.339877 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dd708-bd95-4585-b17d-5984ce2cc950 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:18.351858 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202dd708-bd95-4585-b17d-5984ce2cc950 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:18.357828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-202dd708-bd95-4585-b17d-5984ce2cc950 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:18.357828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:18.357828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:18.357828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:18.357828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:18.357828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:18.357828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:18.357828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:18.357828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:18.357828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:18.357828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:18.357828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:18.357828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:18.357828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:18.357828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:18.357828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:18.358763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:18.358763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:18.358763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:18.358763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:18.358763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:18.358763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:18.358763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:18.358763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:18.358763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:18.358763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:18.358763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:18.358763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:18.358763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:18.358763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:18.358763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:18.358763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:18.359589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:18.359589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:18.359589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:18.359589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:18.359589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:18.359589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:18.359589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:18.359589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:18.359589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:18.359589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:18.359589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:18.359589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:18.362452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 407/812] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:12:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:18.363460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202dd708-bd95-4585-b17d-5984ce2cc950 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:18.397939 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1aabfd-9fd5-45c2-bf44-81abed29b9d1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:18.435895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d08b3-5869-4d4e-a35d-178cfbcbac16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:18.436497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d08b3-5869-4d4e-a35d-178cfbcbac16 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:18.436813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d08b3-5869-4d4e-a35d-178cfbcbac16 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:18.437079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d08b3-5869-4d4e-a35d-178cfbcbac16 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:18.437757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d08b3-5869-4d4e-a35d-178cfbcbac16 None admin] RBAC: Adding query filter params (name=network) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:18.437992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d08b3-5869-4d4e-a35d-178cfbcbac16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:18.439355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d08b3-5869-4d4e-a35d-178cfbcbac16 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:18.444629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 406/813] 10.222.0.107 () {56 vars in 1117 bytes} [Tue Aug 23 23:12:18 2022] GET /identity/v3/services?name=network => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:18.445899 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d08b3-5869-4d4e-a35d-178cfbcbac16 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:18.483391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202dd708-bd95-4585-b17d-5984ce2cc950 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:18.529648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:18.530408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b18404-2ba4-4bb6-a188-88a5287588b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:18.531067 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b18404-2ba4-4bb6-a188-88a5287588b5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:18.531348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b18404-2ba4-4bb6-a188-88a5287588b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:18.531961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b18404-2ba4-4bb6-a188-88a5287588b5 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:18.534291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b18404-2ba4-4bb6-a188-88a5287588b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:18.534739 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b18404-2ba4-4bb6-a188-88a5287588b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:18.536913 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b18404-2ba4-4bb6-a188-88a5287588b5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:18.555554 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d08b3-5869-4d4e-a35d-178cfbcbac16 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:18.565177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 408/814] 10.222.0.107 () {56 vars in 1138 bytes} [Tue Aug 23 23:12:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:18.566495 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b18404-2ba4-4bb6-a188-88a5287588b5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:18.598040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366c85b-5218-4412-bb17-214f4d972c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:18.598686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366c85b-5218-4412-bb17-214f4d972c8b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:18.598961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366c85b-5218-4412-bb17-214f4d972c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:18.599282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366c85b-5218-4412-bb17-214f4d972c8b None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:18.599946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366c85b-5218-4412-bb17-214f4d972c8b None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:18.600266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366c85b-5218-4412-bb17-214f4d972c8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:18.602158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366c85b-5218-4412-bb17-214f4d972c8b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:18.611311 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 407/815] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:18 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:18.612100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366c85b-5218-4412-bb17-214f4d972c8b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:18.627617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:18.689790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b18404-2ba4-4bb6-a188-88a5287588b5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:18.727137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524b4fc-c7c4-4327-8bfb-6db61f3180f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:18.727927 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524b4fc-c7c4-4327-8bfb-6db61f3180f3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:18.728303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524b4fc-c7c4-4327-8bfb-6db61f3180f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:18.728715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524b4fc-c7c4-4327-8bfb-6db61f3180f3 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:18.729443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524b4fc-c7c4-4327-8bfb-6db61f3180f3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:18.729844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524b4fc-c7c4-4327-8bfb-6db61f3180f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:18.731303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524b4fc-c7c4-4327-8bfb-6db61f3180f3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:18.741081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 409/816] 10.222.0.107 () {56 vars in 1117 bytes} [Tue Aug 23 23:12:18 2022] GET /identity/v3/services?type=network => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:18.741081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524b4fc-c7c4-4327-8bfb-6db61f3180f3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:18.746186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366c85b-5218-4412-bb17-214f4d972c8b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:18.790900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e3745-cfac-440c-95c8-11040b6a7fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:18.791663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e3745-cfac-440c-95c8-11040b6a7fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:18.792043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e3745-cfac-440c-95c8-11040b6a7fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:18.792418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e3745-cfac-440c-95c8-11040b6a7fc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:18.805397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:18.864728 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524b4fc-c7c4-4327-8bfb-6db61f3180f3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:18.867476 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:18.872555 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e3745-cfac-440c-95c8-11040b6a7fc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:18.874244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e3745-cfac-440c-95c8-11040b6a7fc4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:18.903699 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853ac74-4c30-4aea-9fb6-8e66afefae8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:18.904590 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853ac74-4c30-4aea-9fb6-8e66afefae8b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:18.905093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853ac74-4c30-4aea-9fb6-8e66afefae8b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:18.905203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853ac74-4c30-4aea-9fb6-8e66afefae8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:18.917389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853ac74-4c30-4aea-9fb6-8e66afefae8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:18.919198 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853ac74-4c30-4aea-9fb6-8e66afefae8b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:18.936209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-0853ac74-4c30-4aea-9fb6-8e66afefae8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:18.936209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:18.936209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:18.936209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:18.936209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:18.936209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:18.936209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:18.936209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:18.936209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:18.936209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:18.936209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:18.936209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:18.936209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:18.936209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:18.936209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:18.936209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:18.937546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:18.937546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:18.937546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:18.937546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:18.937546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:18.937546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:18.937546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:18.937546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:18.937546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:18.937546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:18.937546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:18.937546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:18.937546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:18.937546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:18.937546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:18.937546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:18.937546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:18.938455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:18.938455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:18.938455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:18.942290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 410/817] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:18.943640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853ac74-4c30-4aea-9fb6-8e66afefae8b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:18.999514 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 408/818] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:12:18 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:12:19.000826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e3745-cfac-440c-95c8-11040b6a7fc4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:19.046374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:19.057088 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853ac74-4c30-4aea-9fb6-8e66afefae8b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:19.094718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d31c7-488b-43f0-b3cf-e71ff0bdf6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:19.095210 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d31c7-488b-43f0-b3cf-e71ff0bdf6fd None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.095495 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d31c7-488b-43f0-b3cf-e71ff0bdf6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.095764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d31c7-488b-43f0-b3cf-e71ff0bdf6fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.096577 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d31c7-488b-43f0-b3cf-e71ff0bdf6fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:19.097913 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d31c7-488b-43f0-b3cf-e71ff0bdf6fd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:19.118374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e3745-cfac-440c-95c8-11040b6a7fc4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:19.128636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 411/819] 10.222.0.107 () {60 vars in 1149 bytes} [Tue Aug 23 23:12:18 2022] POST /identity/v3/endpoints => generated 339 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:19.128636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d31c7-488b-43f0-b3cf-e71ff0bdf6fd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:19.169438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:19.211764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b318c-fda1-4daf-ae82-7de86e3d2d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:19.212381 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b318c-fda1-4daf-ae82-7de86e3d2d67 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.212687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b318c-fda1-4daf-ae82-7de86e3d2d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.216624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b318c-fda1-4daf-ae82-7de86e3d2d67 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.216624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b318c-fda1-4daf-ae82-7de86e3d2d67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:19.216624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b318c-fda1-4daf-ae82-7de86e3d2d67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:19.216624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b318c-fda1-4daf-ae82-7de86e3d2d67 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:19.232705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 409/820] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:19.235982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b318c-fda1-4daf-ae82-7de86e3d2d67 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:19.362764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:19.370283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b318c-fda1-4daf-ae82-7de86e3d2d67 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:19.370886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d31c7-488b-43f0-b3cf-e71ff0bdf6fd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:19.417409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55acd70-ed3b-402f-8208-cf6bec855bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:19.418085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55acd70-ed3b-402f-8208-cf6bec855bea None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.418386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55acd70-ed3b-402f-8208-cf6bec855bea None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.418936 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55acd70-ed3b-402f-8208-cf6bec855bea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.419665 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ba2b0-ffbe-4547-9b96-88da1eb60225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:19.421733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ba2b0-ffbe-4547-9b96-88da1eb60225 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.422277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ba2b0-ffbe-4547-9b96-88da1eb60225 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.423368 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ba2b0-ffbe-4547-9b96-88da1eb60225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.427944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55acd70-ed3b-402f-8208-cf6bec855bea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:19.430579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55acd70-ed3b-402f-8208-cf6bec855bea None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:19.436144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ba2b0-ffbe-4547-9b96-88da1eb60225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:19.437623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ba2b0-ffbe-4547-9b96-88da1eb60225 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:19.441883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-a55acd70-ed3b-402f-8208-cf6bec855bea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:12:19.441883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:19.441883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:19.441883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:19.441883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:19.441883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:19.441883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:19.441883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:19.441883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:19.441883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:19.441883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:19.441883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:19.441883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:19.441883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:19.441883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:19.441883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:19.442835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:19.442835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:19.442835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:19.442835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:19.442835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:19.442835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:19.442835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:19.442835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:19.442835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:19.442835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:19.442835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:19.442835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:19.442835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:19.442835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:19.442835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:19.442835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:19.442835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:19.442835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:19.443848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:19.443848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:19.443848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:19.443848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:19.443848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:19.443848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:19.443848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:19.443848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:19.443848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:12:19.443848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:19.443848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 410/821] 10.222.0.107 () {56 vars in 1122 bytes} [Tue Aug 23 23:12:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:19.446194 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3f495-1690-449a-80df-b919ea604795 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.446194 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3f495-1690-449a-80df-b919ea604795 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.446340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3f495-1690-449a-80df-b919ea604795 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.447592 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 411/822] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:19.448549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4210591-084f-4c04-8af5-e0ae37701190 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.448849 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4210591-084f-4c04-8af5-e0ae37701190 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.449113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4210591-084f-4c04-8af5-e0ae37701190 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.450375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 412/823] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:19 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:19.451039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4210591-084f-4c04-8af5-e0ae37701190 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:19.457442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-bc8ba2b0-ffbe-4547-9b96-88da1eb60225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:19.457442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:19.457442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:19.457442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:19.457442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:19.457442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:19.457442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:19.457442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:19.457442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:19.457442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:19.457442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:19.457442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:19.457442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:19.457442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:19.457442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:19.457442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:19.458560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:19.458560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:19.458560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:19.458560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:19.458560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:19.458560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:19.458560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:19.458560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:19.458560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:19.458560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:19.458560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:19.458560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:19.458560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:19.458560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:19.458560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:19.458560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:19.458560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:19.459659 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:19.459659 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:19.459659 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:19.461562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 412/824] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:19.462896 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d2b89-34d0-46e6-8123-fdcd52677a8f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.463179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d2b89-34d0-46e6-8123-fdcd52677a8f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.463452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d2b89-34d0-46e6-8123-fdcd52677a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.481777 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-855d2b89-34d0-46e6-8123-fdcd52677a8f None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:19.482960 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-855d2b89-34d0-46e6-8123-fdcd52677a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:19.542467 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:19.551266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 413/825] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:19 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:19.552417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ae867-ff53-484d-8041-38f1f461f9eb None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.552729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ae867-ff53-484d-8041-38f1f461f9eb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.553087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ae867-ff53-484d-8041-38f1f461f9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.564959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4210591-084f-4c04-8af5-e0ae37701190 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:19.583843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-eb6ae867-ff53-484d-8041-38f1f461f9eb None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:19.585789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-eb6ae867-ff53-484d-8041-38f1f461f9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:19.601692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5de69e-7982-4d72-98ac-2b38b09344cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:19.602301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5de69e-7982-4d72-98ac-2b38b09344cb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.602567 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5de69e-7982-4d72-98ac-2b38b09344cb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.602845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5de69e-7982-4d72-98ac-2b38b09344cb None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.603579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5de69e-7982-4d72-98ac-2b38b09344cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:19.603933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5de69e-7982-4d72-98ac-2b38b09344cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:19.605344 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5de69e-7982-4d72-98ac-2b38b09344cb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:19.628288 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 413/826] 10.222.0.107 () {56 vars in 1154 bytes} [Tue Aug 23 23:12:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:19.628953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5de69e-7982-4d72-98ac-2b38b09344cb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:19.644694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:19.661472 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 414/827] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:19 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:19.662696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ae867-ff53-484d-8041-38f1f461f9eb None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:19.754745 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5de69e-7982-4d72-98ac-2b38b09344cb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:19.781138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ae867-ff53-484d-8041-38f1f461f9eb None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:19.807726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:19.808005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00742179-eb8d-4c45-90fd-1c6b49d9ad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:19.809279 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00742179-eb8d-4c45-90fd-1c6b49d9ad7c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.809897 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00742179-eb8d-4c45-90fd-1c6b49d9ad7c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.810363 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00742179-eb8d-4c45-90fd-1c6b49d9ad7c None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.812114 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00742179-eb8d-4c45-90fd-1c6b49d9ad7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:19.813032 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00742179-eb8d-4c45-90fd-1c6b49d9ad7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:19.815119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00742179-eb8d-4c45-90fd-1c6b49d9ad7c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:19.822390 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257308b8-0155-489c-b8c6-a7532cbf9700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:19.823032 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257308b8-0155-489c-b8c6-a7532cbf9700 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.823306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257308b8-0155-489c-b8c6-a7532cbf9700 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.823684 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257308b8-0155-489c-b8c6-a7532cbf9700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.829368 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 414/828] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:19.833274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00742179-eb8d-4c45-90fd-1c6b49d9ad7c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:19.837501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257308b8-0155-489c-b8c6-a7532cbf9700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:19.838967 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257308b8-0155-489c-b8c6-a7532cbf9700 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:19.856233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-257308b8-0155-489c-b8c6-a7532cbf9700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:19.856233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:19.856233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:19.856233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:19.856233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:19.856233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:19.856233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:19.856233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:19.856233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:19.856233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:19.856233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:19.856233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:19.856233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:19.856233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:19.856233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:19.856233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:19.857430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:19.857430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:19.857430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:19.857430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:19.857430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:19.857430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:19.857430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:19.857430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:19.857430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:19.857430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:19.857430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:19.857430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:19.857430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:19.857430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:19.857430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:19.857430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:19.857430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:19.858339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:19.858339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:19.858339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:19.858339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 415/829] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:19.859313 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257308b8-0155-489c-b8c6-a7532cbf9700 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:19.914561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:19.950572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00742179-eb8d-4c45-90fd-1c6b49d9ad7c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:19.977805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257308b8-0155-489c-b8c6-a7532cbf9700 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:19.984701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ecb4d-602c-45e9-97dc-8d218122f881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:19.985471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ecb4d-602c-45e9-97dc-8d218122f881 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:19.985752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ecb4d-602c-45e9-97dc-8d218122f881 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:19.986028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ecb4d-602c-45e9-97dc-8d218122f881 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:19.997449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ecb4d-602c-45e9-97dc-8d218122f881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:20.002647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8e6ecb4d-602c-45e9-97dc-8d218122f881 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:20.002647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:20.002647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:20.002647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:20.002647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:20.002647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:20.002647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:20.002647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:20.002647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:20.002647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:20.002647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:20.002647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:20.002647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:20.002647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:20.002647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:20.002647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:20.003630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:20.003630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:20.003630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:20.003630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:20.003630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:20.003630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:20.003630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:20.003630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:20.003630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:20.003630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:20.003630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:20.003630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:20.003630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:20.003630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:20.003630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:20.003630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:20.004972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:20.004972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:20.004972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:20.004972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:20.004972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:20.004972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:20.004972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:20.004972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:20.004972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:20.004972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:20.004972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:20.004972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:20.004972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 415/830] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:20.004972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ecb4d-602c-45e9-97dc-8d218122f881 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:20.017100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ca6d9-5087-4299-9a50-adcd75a89dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:20.017737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ca6d9-5087-4299-9a50-adcd75a89dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:20.018017 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ca6d9-5087-4299-9a50-adcd75a89dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:20.018284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ca6d9-5087-4299-9a50-adcd75a89dc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:20.025581 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ca6d9-5087-4299-9a50-adcd75a89dc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:20.027041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ca6d9-5087-4299-9a50-adcd75a89dc6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:20.039139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-0d3ca6d9-5087-4299-9a50-adcd75a89dc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:20.039139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:20.039139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:20.039139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:20.039139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:20.039139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:20.039139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:20.039139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:20.039139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:20.039139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:20.039139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:20.039139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:20.039139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:20.039139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:20.039139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:20.040195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:20.040195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:20.040195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:20.040195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:20.040195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:20.040195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:20.040195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:20.040195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:20.040195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:20.040195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:20.040195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:20.040195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:20.040195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:20.040195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:20.040195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:20.040195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:20.040195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:20.041125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:20.041125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:20.041125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:20.041125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:20.041125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:20.041125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:20.041125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:20.041125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:20.041125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 416/831] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:20.041599 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ca6d9-5087-4299-9a50-adcd75a89dc6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:20.078997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:20.110449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ecb4d-602c-45e9-97dc-8d218122f881 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:20.141389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:20.147873 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3ae7c-e040-489d-82a7-1176450f9c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:20.148464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3ae7c-e040-489d-82a7-1176450f9c0c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:20.148774 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3ae7c-e040-489d-82a7-1176450f9c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:20.149043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3ae7c-e040-489d-82a7-1176450f9c0c None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:20.149681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3ae7c-e040-489d-82a7-1176450f9c0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:20.150005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3ae7c-e040-489d-82a7-1176450f9c0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:20.150771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ca6d9-5087-4299-9a50-adcd75a89dc6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:20.151367 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3ae7c-e040-489d-82a7-1176450f9c0c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:20.163153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 416/832] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:20.163833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3ae7c-e040-489d-82a7-1176450f9c0c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:20.189534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdcc0f-87af-4700-ace2-7127c52cb2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:20.190087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdcc0f-87af-4700-ace2-7127c52cb2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:20.190363 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdcc0f-87af-4700-ace2-7127c52cb2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:20.190632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdcc0f-87af-4700-ace2-7127c52cb2f1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:20.191212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fdcc0f-87af-4700-ace2-7127c52cb2f1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:20.192573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fdcc0f-87af-4700-ace2-7127c52cb2f1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:20.201789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-48fdcc0f-87af-4700-ace2-7127c52cb2f1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:12:20.201789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:20.201789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:20.201789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:20.201789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:20.201789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:20.201789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:20.201789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:20.201789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:12:20.201789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:20.201789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:20.201789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:20.201789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:20.201789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:20.201789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:20.201789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:20.201789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:20.202986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:20.202986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:20.202986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:20.202986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:20.202986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:20.202986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:20.202986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:20.202986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:20.202986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:20.202986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:20.202986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:20.202986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:20.202986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:20.202986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:20.202986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:20.202986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:20.203811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:20.203811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:20.203811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:20.203811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:20.203811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:20.203811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:20.203811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:20.203811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:20.203811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:20.203811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:20.203811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:20.203811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:20.203811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:12:20.203811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:20.203811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 417/833] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:12:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:20.204626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdcc0f-87af-4700-ace2-7127c52cb2f1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:20.268964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3ae7c-e040-489d-82a7-1176450f9c0c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:20.308336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:20.311366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465d0ac-d2dd-4973-bb00-b7dc6ca6d48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:20.311705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdcc0f-87af-4700-ace2-7127c52cb2f1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:20.311976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465d0ac-d2dd-4973-bb00-b7dc6ca6d48c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:20.312245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465d0ac-d2dd-4973-bb00-b7dc6ca6d48c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:20.312519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465d0ac-d2dd-4973-bb00-b7dc6ca6d48c None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:20.313203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465d0ac-d2dd-4973-bb00-b7dc6ca6d48c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:20.313615 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465d0ac-d2dd-4973-bb00-b7dc6ca6d48c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:20.314857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465d0ac-d2dd-4973-bb00-b7dc6ca6d48c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:20.323218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 417/834] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:12:20 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:20.324102 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465d0ac-d2dd-4973-bb00-b7dc6ca6d48c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:20.347449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63aebb-8c9e-4ee6-b26a-b8490c0b4fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:20.348046 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63aebb-8c9e-4ee6-b26a-b8490c0b4fda None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:20.348317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63aebb-8c9e-4ee6-b26a-b8490c0b4fda None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:20.348583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63aebb-8c9e-4ee6-b26a-b8490c0b4fda None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:20.349290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e63aebb-8c9e-4ee6-b26a-b8490c0b4fda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:20.349589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e63aebb-8c9e-4ee6-b26a-b8490c0b4fda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:20.351945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e63aebb-8c9e-4ee6-b26a-b8490c0b4fda None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:20.363855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 418/835] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:20.364683 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63aebb-8c9e-4ee6-b26a-b8490c0b4fda None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:20.380870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:20.426950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465d0ac-d2dd-4973-bb00-b7dc6ca6d48c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:20.460764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f41ee3-ebed-4d82-9421-a3730a8ab8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:20.461388 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f41ee3-ebed-4d82-9421-a3730a8ab8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:20.461668 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f41ee3-ebed-4d82-9421-a3730a8ab8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:20.461934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f41ee3-ebed-4d82-9421-a3730a8ab8b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:20.463975 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63aebb-8c9e-4ee6-b26a-b8490c0b4fda None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:20.473340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f41ee3-ebed-4d82-9421-a3730a8ab8b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:20.474916 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f41ee3-ebed-4d82-9421-a3730a8ab8b8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:20.487093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-43f41ee3-ebed-4d82-9421-a3730a8ab8b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:20.487093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:20.487093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:20.487093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:20.487093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:20.487093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:20.487093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:20.487093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:20.487093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:20.487093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:20.487093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:20.487093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:20.487093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:20.487093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:20.487093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:20.488003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:20.488003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:20.488003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:20.488003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:20.488003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:20.488003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:20.488003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:20.488003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:20.488003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:20.488003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:20.488003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:20.488003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:20.488003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:20.488003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:20.488003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:20.488003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:20.488003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:20.488935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:20.488935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:20.488935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:20.488935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:20.488935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:20.488935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:20.488935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:20.488935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:20.488935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 418/836] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:20.489417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f41ee3-ebed-4d82-9421-a3730a8ab8b8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:20.501553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a52d95-682d-4507-80f0-fc3ae389e48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:20.502163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a52d95-682d-4507-80f0-fc3ae389e48d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:20.502430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a52d95-682d-4507-80f0-fc3ae389e48d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:20.502694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a52d95-682d-4507-80f0-fc3ae389e48d None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:20.503318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a52d95-682d-4507-80f0-fc3ae389e48d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:20.503614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a52d95-682d-4507-80f0-fc3ae389e48d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:20.505006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a52d95-682d-4507-80f0-fc3ae389e48d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:20.510531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 419/837] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:12:20 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:20.511314 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a52d95-682d-4507-80f0-fc3ae389e48d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:20.536129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:20.595765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f41ee3-ebed-4d82-9421-a3730a8ab8b8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:20.611375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:20.620800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a52d95-682d-4507-80f0-fc3ae389e48d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:20.632438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c556ed-e6e5-4bb3-928d-0b9069120f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:20.633239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c556ed-e6e5-4bb3-928d-0b9069120f58 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:20.633519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c556ed-e6e5-4bb3-928d-0b9069120f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:20.633792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c556ed-e6e5-4bb3-928d-0b9069120f58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:20.644239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c556ed-e6e5-4bb3-928d-0b9069120f58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:20.645712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c556ed-e6e5-4bb3-928d-0b9069120f58 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:20.657352 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22f67a-b296-4b20-a9f2-6dc6ab262539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:20.657957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22f67a-b296-4b20-a9f2-6dc6ab262539 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:20.658241 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22f67a-b296-4b20-a9f2-6dc6ab262539 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:20.658509 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22f67a-b296-4b20-a9f2-6dc6ab262539 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:20.659229 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22f67a-b296-4b20-a9f2-6dc6ab262539 None admin] RBAC: Adding query filter params (role.id=97ece22f2e264e0e857d5107325a85d9, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=2f985626d8af4f3089e72998fad98b47) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:20.659536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22f67a-b296-4b20-a9f2-6dc6ab262539 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:20.660284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-d8c556ed-e6e5-4bb3-928d-0b9069120f58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:20.660284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:20.660284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:20.660284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:20.660284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:20.660284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:20.660284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:20.660284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:20.660284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:20.660284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:20.660284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:20.660284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:20.660284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:20.660284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:20.660284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:20.660284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:20.662003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:20.662003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:20.662003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:20.662003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:20.662003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:20.662003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:20.662003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:20.662003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:20.662003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:20.662003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:20.662003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:20.662003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:20.662003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:20.662003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:20.662003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:20.662003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:20.662003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:20.664346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:20.664346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:20.664346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:20.664739 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22f67a-b296-4b20-a9f2-6dc6ab262539 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:20.664903 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 419/838] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:20.664903 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c556ed-e6e5-4bb3-928d-0b9069120f58 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:20.672847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 420/839] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:12:20 2022] GET /identity/v3/role_assignments?user.id=2f985626d8af4f3089e72998fad98b47&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 610 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:20.673562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22f67a-b296-4b20-a9f2-6dc6ab262539 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:20.775691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c556ed-e6e5-4bb3-928d-0b9069120f58 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:20.788922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:20.806139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22f67a-b296-4b20-a9f2-6dc6ab262539 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:20.817454 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70472a-4e0e-4776-a9b0-ba3aa37c0950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:20.818343 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70472a-4e0e-4776-a9b0-ba3aa37c0950 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:20.818784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70472a-4e0e-4776-a9b0-ba3aa37c0950 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:20.819293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70472a-4e0e-4776-a9b0-ba3aa37c0950 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:20.820215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70472a-4e0e-4776-a9b0-ba3aa37c0950 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:20.820697 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70472a-4e0e-4776-a9b0-ba3aa37c0950 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:20.822327 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70472a-4e0e-4776-a9b0-ba3aa37c0950 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:20.841815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 420/840] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:20.842801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70472a-4e0e-4776-a9b0-ba3aa37c0950 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:20.849972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3996a3e-ed44-44e6-976c-4da9704ded4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:20.851410 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3996a3e-ed44-44e6-976c-4da9704ded4f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:20.851716 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3996a3e-ed44-44e6-976c-4da9704ded4f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:20.851987 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3996a3e-ed44-44e6-976c-4da9704ded4f None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:20.852692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3996a3e-ed44-44e6-976c-4da9704ded4f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:20.852961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3996a3e-ed44-44e6-976c-4da9704ded4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:20.854341 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3996a3e-ed44-44e6-976c-4da9704ded4f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:20.859366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 421/841] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:12:20 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:20.860199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3996a3e-ed44-44e6-976c-4da9704ded4f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:20.877443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:20.979910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70472a-4e0e-4776-a9b0-ba3aa37c0950 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:21.014968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3996a3e-ed44-44e6-976c-4da9704ded4f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:21.025999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d142c99-019f-4fbe-8e6c-e723ee2ee2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:21.026837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d142c99-019f-4fbe-8e6c-e723ee2ee2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:21.027268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d142c99-019f-4fbe-8e6c-e723ee2ee2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:21.027705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d142c99-019f-4fbe-8e6c-e723ee2ee2d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:21.028519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d142c99-019f-4fbe-8e6c-e723ee2ee2d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:21.028979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d142c99-019f-4fbe-8e6c-e723ee2ee2d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:21.030500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d142c99-019f-4fbe-8e6c-e723ee2ee2d6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:21.045013 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 421/842] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:21.050774 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d142c99-019f-4fbe-8e6c-e723ee2ee2d6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:21.057983 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822cafb-db2f-479d-960d-020cd4e4c4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:21.058661 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822cafb-db2f-479d-960d-020cd4e4c4d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:21.058935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822cafb-db2f-479d-960d-020cd4e4c4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:21.059203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822cafb-db2f-479d-960d-020cd4e4c4d6 None admin] PATH_INFO: `/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/238ad0efedfd4cd89d99e2abebaeba63/roles/ee7f9512e7e745199ff5ed847343d11a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:21.077797 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822cafb-db2f-479d-960d-020cd4e4c4d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7cdd07c79614516be35aa2d82ec6a3b, user_id=238ad0efedfd4cd89d99e2abebaeba63, role_id=ee7f9512e7e745199ff5ed847343d11a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:21.079608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822cafb-db2f-479d-960d-020cd4e4c4d6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:21.097715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 422/843] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:12:20 2022] PUT /identity/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/238ad0efedfd4cd89d99e2abebaeba63/roles/ee7f9512e7e745199ff5ed847343d11a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:12:21.164204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:21.182420 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d142c99-019f-4fbe-8e6c-e723ee2ee2d6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:21.221920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a75bd-35c3-4723-bd23-3b18dab4cd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:21.222667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a75bd-35c3-4723-bd23-3b18dab4cd77 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:21.222943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a75bd-35c3-4723-bd23-3b18dab4cd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:21.223209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a75bd-35c3-4723-bd23-3b18dab4cd77 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:21.233090 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a75bd-35c3-4723-bd23-3b18dab4cd77 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:21.234578 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a75bd-35c3-4723-bd23-3b18dab4cd77 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:21.249266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-778a75bd-35c3-4723-bd23-3b18dab4cd77 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:12:21.249266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:21.249266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:21.249266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:21.249266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:21.249266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:21.249266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:21.249266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:21.249266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:21.249266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:21.249266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:21.249266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:21.249266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:21.249266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:21.249266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:21.249266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:21.260479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:21.260479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:21.260479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:21.260479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:21.260479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:21.260479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:21.260479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:21.260479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:21.260479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:21.260479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:21.260479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:21.260479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:21.260479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:21.260479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:21.260479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:21.260479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:21.260479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:21.260479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:21.261747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:21.261747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:21.261747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:21.261747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:21.261747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:21.261747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:21.261747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:21.261747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:21.261747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:12:21.261747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:21.261747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 422/844] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:21.262676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822cafb-db2f-479d-960d-020cd4e4c4d6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:21.264082 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:21.375652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822cafb-db2f-479d-960d-020cd4e4c4d6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:21.416012 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f81c4-a3ae-4965-a785-9aeed2864be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:21.416637 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f81c4-a3ae-4965-a785-9aeed2864be5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:21.416919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f81c4-a3ae-4965-a785-9aeed2864be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:21.417190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f81c4-a3ae-4965-a785-9aeed2864be5 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:21.417918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f81c4-a3ae-4965-a785-9aeed2864be5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:21.418219 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f81c4-a3ae-4965-a785-9aeed2864be5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:21.419910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f81c4-a3ae-4965-a785-9aeed2864be5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:21.439785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 423/845] 10.222.0.107 () {56 vars in 1140 bytes} [Tue Aug 23 23:12:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:21.445824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a75bd-35c3-4723-bd23-3b18dab4cd77 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:21.553586 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a75bd-35c3-4723-bd23-3b18dab4cd77 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:21.589799 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f25e33-feb6-4cba-a555-62f2c324157c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:21.590409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f25e33-feb6-4cba-a555-62f2c324157c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:21.590681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f25e33-feb6-4cba-a555-62f2c324157c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:21.590951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f25e33-feb6-4cba-a555-62f2c324157c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:21.607477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:21.663662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f25e33-feb6-4cba-a555-62f2c324157c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:21.665162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f25e33-feb6-4cba-a555-62f2c324157c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:21.768522 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 423/846] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:12:21 2022] GET /identity/v3/auth/tokens => generated 1163 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:12:21.774823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f81c4-a3ae-4965-a785-9aeed2864be5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:21.839426 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:21.887188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f81c4-a3ae-4965-a785-9aeed2864be5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:21.923754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48426b4c-cda1-4c22-98cb-5f913f580131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:21.924384 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48426b4c-cda1-4c22-98cb-5f913f580131 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:21.924685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48426b4c-cda1-4c22-98cb-5f913f580131 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:21.924956 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48426b4c-cda1-4c22-98cb-5f913f580131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:21.936635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48426b4c-cda1-4c22-98cb-5f913f580131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:21.938225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48426b4c-cda1-4c22-98cb-5f913f580131 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:21.955701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-48426b4c-cda1-4c22-98cb-5f913f580131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:21.955701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:21.955701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:21.955701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:21.955701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:21.955701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:21.955701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:21.955701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:21.955701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:21.955701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:21.955701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:21.955701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:21.955701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:21.955701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:21.955701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:21.955701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:21.956763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:21.956763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:21.956763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:21.956763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:21.956763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:21.956763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:21.956763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:21.956763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:21.956763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:21.956763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:21.956763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:21.956763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:21.956763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:21.956763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:21.956763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:21.956763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:21.956763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:21.958077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:21.958077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:21.958077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:21.958077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 424/847] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:21.967014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f25e33-feb6-4cba-a555-62f2c324157c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:22.036038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:22.094512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f25e33-feb6-4cba-a555-62f2c324157c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:22.134079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342482a9-ed48-4d90-98c0-ec64be7cc744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:22.135095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342482a9-ed48-4d90-98c0-ec64be7cc744 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:22.135587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342482a9-ed48-4d90-98c0-ec64be7cc744 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:22.136073 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342482a9-ed48-4d90-98c0-ec64be7cc744 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:22.136988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342482a9-ed48-4d90-98c0-ec64be7cc744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:22.137509 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342482a9-ed48-4d90-98c0-ec64be7cc744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:22.139176 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342482a9-ed48-4d90-98c0-ec64be7cc744 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:22.152618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 424/848] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:22.161389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48426b4c-cda1-4c22-98cb-5f913f580131 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:22.346631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48426b4c-cda1-4c22-98cb-5f913f580131 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:22.376961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:22.406839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9ba4b-4895-415a-a974-aaac2395e6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:22.407890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9ba4b-4895-415a-a974-aaac2395e6a0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:22.408377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9ba4b-4895-415a-a974-aaac2395e6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:22.408893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9ba4b-4895-415a-a974-aaac2395e6a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:22.421243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9ba4b-4895-415a-a974-aaac2395e6a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:22.424046 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9ba4b-4895-415a-a974-aaac2395e6a0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:22.446160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f2a9ba4b-4895-415a-a974-aaac2395e6a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:22.446160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:22.446160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:22.446160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:22.446160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:22.446160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:22.446160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:22.446160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:22.446160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:22.446160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:22.446160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:22.446160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:22.446160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:22.446160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:22.446160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:22.447148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:22.447148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:22.447148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:22.447148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:22.447148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:22.447148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:22.447148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:22.447148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:22.447148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:22.447148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:22.447148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:22.447148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:22.447148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:22.447148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:22.447148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:22.447148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:22.447148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:22.448085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:22.448085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:22.448085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:22.448085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:22.448085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:22.448085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:22.448085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:22.448085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:22.449228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 425/849] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:22.458181 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342482a9-ed48-4d90-98c0-ec64be7cc744 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:22.636709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342482a9-ed48-4d90-98c0-ec64be7cc744 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:22.650027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:22.679684 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857122a-8085-4be8-94dc-b14f7d0cf339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:22.680351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857122a-8085-4be8-94dc-b14f7d0cf339 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:22.680646 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857122a-8085-4be8-94dc-b14f7d0cf339 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:22.680926 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857122a-8085-4be8-94dc-b14f7d0cf339 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:22.681619 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857122a-8085-4be8-94dc-b14f7d0cf339 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:22.681924 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857122a-8085-4be8-94dc-b14f7d0cf339 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:22.683362 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857122a-8085-4be8-94dc-b14f7d0cf339 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:22.696401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 425/850] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:22.706074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9ba4b-4895-415a-a974-aaac2395e6a0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:22.888328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9ba4b-4895-415a-a974-aaac2395e6a0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:22.950345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3993732-fa66-4a9d-88fc-34fae4c1922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:22.951838 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3993732-fa66-4a9d-88fc-34fae4c1922b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:22.952649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3993732-fa66-4a9d-88fc-34fae4c1922b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:22.953418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3993732-fa66-4a9d-88fc-34fae4c1922b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:22.955024 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3993732-fa66-4a9d-88fc-34fae4c1922b None admin] RBAC: Adding query filter params (role.id=97ece22f2e264e0e857d5107325a85d9, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=35d0b95b22bc4117957cbc3afa5547a4) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:22.955862 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3993732-fa66-4a9d-88fc-34fae4c1922b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:22.959089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3993732-fa66-4a9d-88fc-34fae4c1922b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:22.970788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 426/851] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:12:22 2022] GET /identity/v3/role_assignments?user.id=35d0b95b22bc4117957cbc3afa5547a4&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 610 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:23.009296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89157a-561f-4f7c-8c95-29ac0112a4c7 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:23.009608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89157a-561f-4f7c-8c95-29ac0112a4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:23.009968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89157a-561f-4f7c-8c95-29ac0112a4c7 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:23.011471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 426/852] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:23.018145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269df20-5d50-49bd-a500-fb2594cb9e5b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:23.019066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269df20-5d50-49bd-a500-fb2594cb9e5b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:23.019813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269df20-5d50-49bd-a500-fb2594cb9e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:23.055027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d269df20-5d50-49bd-a500-fb2594cb9e5b None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:23.057646 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d269df20-5d50-49bd-a500-fb2594cb9e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:23.121638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:23.188378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 427/853] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:23 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:23.229673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32997cf4-3056-4e91-adfd-eb9603d135b4 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:23.230017 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32997cf4-3056-4e91-adfd-eb9603d135b4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:23.230225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32997cf4-3056-4e91-adfd-eb9603d135b4 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:23.231847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 427/854] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:23.237331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec91ea-0afb-43b6-accb-7537855021bf None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:23.237619 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec91ea-0afb-43b6-accb-7537855021bf None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:23.237898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec91ea-0afb-43b6-accb-7537855021bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:23.259633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-30ec91ea-0afb-43b6-accb-7537855021bf None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:23.260880 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-30ec91ea-0afb-43b6-accb-7537855021bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:23.332223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 428/855] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:23 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:23.352917 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207ae6b-bfc8-4e2f-82bb-764af0f5f13a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:23.353245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207ae6b-bfc8-4e2f-82bb-764af0f5f13a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:23.353471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207ae6b-bfc8-4e2f-82bb-764af0f5f13a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:23.355065 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 428/856] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:23.360359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850ef1c-b80a-4b1b-985c-65202792c7b9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:23.360677 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850ef1c-b80a-4b1b-985c-65202792c7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:23.360955 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850ef1c-b80a-4b1b-985c-65202792c7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:23.379448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1850ef1c-b80a-4b1b-985c-65202792c7b9 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:23.380675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1850ef1c-b80a-4b1b-985c-65202792c7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:23.454215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 429/857] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:23 2022] POST /identity/v3/auth/tokens => generated 1163 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:23.492880 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207ae6b-bfc8-4e2f-82bb-764af0f5f13a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:23.606818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850ef1c-b80a-4b1b-985c-65202792c7b9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:23.607410 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207ae6b-bfc8-4e2f-82bb-764af0f5f13a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:23.636472 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:23.653720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442e452-d2c5-4797-9e4a-b856d5b6142d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:23.655125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442e452-d2c5-4797-9e4a-b856d5b6142d None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:23.655408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442e452-d2c5-4797-9e4a-b856d5b6142d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:23.655730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442e452-d2c5-4797-9e4a-b856d5b6142d None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:23.656889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442e452-d2c5-4797-9e4a-b856d5b6142d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:23.658801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442e452-d2c5-4797-9e4a-b856d5b6142d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:23.681427 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 429/858] 10.222.0.107 () {60 vars in 1146 bytes} [Tue Aug 23 23:12:23 2022] POST /identity/v3/services => generated 252 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:23.731066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850ef1c-b80a-4b1b-985c-65202792c7b9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:23.732940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442e452-d2c5-4797-9e4a-b856d5b6142d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:23.782413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268ff2a-f18b-4ffd-b2e4-3a0a9c8e1116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:23.783064 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268ff2a-f18b-4ffd-b2e4-3a0a9c8e1116 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:23.783335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268ff2a-f18b-4ffd-b2e4-3a0a9c8e1116 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:23.783598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268ff2a-f18b-4ffd-b2e4-3a0a9c8e1116 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:23.792459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:23.797461 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268ff2a-f18b-4ffd-b2e4-3a0a9c8e1116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:23.802423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d268ff2a-f18b-4ffd-b2e4-3a0a9c8e1116 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:23.802423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:23.802423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:23.802423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:23.802423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:23.802423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:23.802423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:23.802423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:23.802423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:23.802423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:23.802423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:23.802423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:23.802423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:23.802423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:23.802423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:23.802423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:23.804199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:23.804199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:23.804199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:23.804199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:23.804199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:23.804199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:23.804199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:23.804199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:23.804199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:23.804199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:23.804199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:23.804199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:23.804199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:23.804199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:23.804199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:23.804199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:23.805421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:23.805421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:23.805421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:23.805421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:23.805421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:23.805421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:23.805421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:23.805421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:23.805421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:23.805421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:23.805421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:12:23.805421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:23.805421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 430/859] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:12:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:23.814565 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268ff2a-f18b-4ffd-b2e4-3a0a9c8e1116 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:23.881646 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442e452-d2c5-4797-9e4a-b856d5b6142d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:23.924523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:23.937521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5f074-7112-40b1-b2f2-b7d075ca6982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:23.938675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5f074-7112-40b1-b2f2-b7d075ca6982 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:23.939113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5f074-7112-40b1-b2f2-b7d075ca6982 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:23.939847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5f074-7112-40b1-b2f2-b7d075ca6982 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:23.941059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5f074-7112-40b1-b2f2-b7d075ca6982 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:23.943107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5f074-7112-40b1-b2f2-b7d075ca6982 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:23.947580 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268ff2a-f18b-4ffd-b2e4-3a0a9c8e1116 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:23.958520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-fdd5f074-7112-40b1-b2f2-b7d075ca6982 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:12:23.958520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:23.958520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:23.958520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:23.958520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:23.958520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:23.958520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:23.958520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:23.958520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:12:23.958520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:23.958520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:23.958520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:23.958520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:23.958520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:23.958520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:23.958520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:23.959556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:23.959556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:23.959556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:23.959556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:23.959556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:23.959556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:23.959556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:23.959556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:23.959556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:23.959556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:23.959556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:23.959556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:23.959556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:23.959556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:23.959556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:23.959556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:23.959556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:23.961351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:23.961351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:23.961351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:23.961351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:23.961351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:23.961351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:23.961351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:23.961351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:23.961351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:23.961351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:23.961351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:23.961351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:23.961351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:12:23.961351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:23.962772 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 430/860] 10.222.0.107 () {56 vars in 1137 bytes} [Tue Aug 23 23:12:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:23.968895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5f074-7112-40b1-b2f2-b7d075ca6982 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:23.999557 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6c0b0-2479-471a-8d25-0e7e89bf9657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:24.000689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6c0b0-2479-471a-8d25-0e7e89bf9657 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:24.001540 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6c0b0-2479-471a-8d25-0e7e89bf9657 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:24.001978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6c0b0-2479-471a-8d25-0e7e89bf9657 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:24.002806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6c0b0-2479-471a-8d25-0e7e89bf9657 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:24.003274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6c0b0-2479-471a-8d25-0e7e89bf9657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:24.005486 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6c0b0-2479-471a-8d25-0e7e89bf9657 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:24.018790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 431/861] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:12:23 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:24.029673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6c0b0-2479-471a-8d25-0e7e89bf9657 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:24.105117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:24.120541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5f074-7112-40b1-b2f2-b7d075ca6982 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:24.159768 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6c0b0-2479-471a-8d25-0e7e89bf9657 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:24.168899 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa7398-4625-4147-b97e-b56442705b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:24.170323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa7398-4625-4147-b97e-b56442705b7b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:24.170773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa7398-4625-4147-b97e-b56442705b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:24.171186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa7398-4625-4147-b97e-b56442705b7b None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:24.171992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa7398-4625-4147-b97e-b56442705b7b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:24.172448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa7398-4625-4147-b97e-b56442705b7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:24.174953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa7398-4625-4147-b97e-b56442705b7b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:24.182743 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 431/862] 10.222.0.107 () {56 vars in 1131 bytes} [Tue Aug 23 23:12:23 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:24.189478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa7398-4625-4147-b97e-b56442705b7b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:24.209401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f58653-097f-4fa6-a096-9c4029a6a3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:24.210757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58653-097f-4fa6-a096-9c4029a6a3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:24.211111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58653-097f-4fa6-a096-9c4029a6a3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:24.211450 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58653-097f-4fa6-a096-9c4029a6a3c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:24.222754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f58653-097f-4fa6-a096-9c4029a6a3c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:24.224338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f58653-097f-4fa6-a096-9c4029a6a3c3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:24.228001 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:24.242573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-29f58653-097f-4fa6-a096-9c4029a6a3c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:24.242573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:24.242573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:24.242573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:24.242573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:24.242573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:24.242573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:24.242573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:24.242573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:24.242573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:24.242573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:24.242573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:24.242573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:24.242573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:24.242573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:24.242573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:24.243605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:24.243605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:24.243605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:24.243605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:24.243605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:24.243605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:24.243605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:24.243605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:24.243605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:24.243605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:24.243605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:24.243605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:24.243605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:24.243605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:24.243605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:24.243605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:24.243605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:24.244488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:24.244488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:24.244488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:24.244488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 432/863] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:24.250623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f58653-097f-4fa6-a096-9c4029a6a3c3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:24.327980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa7398-4625-4147-b97e-b56442705b7b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:24.367367 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a339f3f-17da-43f1-bd51-259836415cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:24.367970 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a339f3f-17da-43f1-bd51-259836415cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:24.368247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a339f3f-17da-43f1-bd51-259836415cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:24.368504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a339f3f-17da-43f1-bd51-259836415cf8 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:24.369216 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a339f3f-17da-43f1-bd51-259836415cf8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:24.369513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a339f3f-17da-43f1-bd51-259836415cf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:24.370866 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a339f3f-17da-43f1-bd51-259836415cf8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:24.376560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f58653-097f-4fa6-a096-9c4029a6a3c3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:24.380949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 432/864] 10.222.0.107 () {56 vars in 1131 bytes} [Tue Aug 23 23:12:24 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:24.419685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7302c84-f592-4ec5-83d2-2648832bc716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:24.420738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7302c84-f592-4ec5-83d2-2648832bc716 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:24.421239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7302c84-f592-4ec5-83d2-2648832bc716 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:24.421734 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7302c84-f592-4ec5-83d2-2648832bc716 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:24.422601 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7302c84-f592-4ec5-83d2-2648832bc716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:24.423128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7302c84-f592-4ec5-83d2-2648832bc716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:24.424794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7302c84-f592-4ec5-83d2-2648832bc716 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:24.440183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 433/865] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:24.446329 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a339f3f-17da-43f1-bd51-259836415cf8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:24.468666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:24.563200 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a339f3f-17da-43f1-bd51-259836415cf8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:24.600381 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec21ef0-aca5-4575-a13f-106f7f8b2267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:24.601205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec21ef0-aca5-4575-a13f-106f7f8b2267 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:24.601484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec21ef0-aca5-4575-a13f-106f7f8b2267 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:24.601752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec21ef0-aca5-4575-a13f-106f7f8b2267 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:24.609553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec21ef0-aca5-4575-a13f-106f7f8b2267 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:24.610985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec21ef0-aca5-4575-a13f-106f7f8b2267 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:24.623116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-6ec21ef0-aca5-4575-a13f-106f7f8b2267 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:12:24.623116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:24.623116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:24.623116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:24.623116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:24.623116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:24.623116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:24.623116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:24.623116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:24.623116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:24.623116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:24.623116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:24.623116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:24.623116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:24.623116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:24.623116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:24.624188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:24.624188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:24.624188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:24.624188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:24.624188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:24.624188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:24.624188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:24.624188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:24.624188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:24.624188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:24.624188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:24.624188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:24.624188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:24.624188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:24.624188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:24.624188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:24.624188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:24.624188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:24.625261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:24.625261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:24.625261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:24.625261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:24.625261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:24.625261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:24.625261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:24.625261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:24.625261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:12:24.625261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:24.625261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 433/866] 10.222.0.107 () {56 vars in 1122 bytes} [Tue Aug 23 23:12:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:24.632749 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7302c84-f592-4ec5-83d2-2648832bc716 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:24.695121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:24.744059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7302c84-f592-4ec5-83d2-2648832bc716 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:24.781926 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf35a68-9260-4e54-adf6-d0bd8539ea30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:24.783015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf35a68-9260-4e54-adf6-d0bd8539ea30 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:24.783513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf35a68-9260-4e54-adf6-d0bd8539ea30 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:24.784018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf35a68-9260-4e54-adf6-d0bd8539ea30 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:24.785007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf35a68-9260-4e54-adf6-d0bd8539ea30 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:24.785518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf35a68-9260-4e54-adf6-d0bd8539ea30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:24.787172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf35a68-9260-4e54-adf6-d0bd8539ea30 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:24.807078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 434/867] 10.222.0.107 () {56 vars in 1154 bytes} [Tue Aug 23 23:12:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:24.812955 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec21ef0-aca5-4575-a13f-106f7f8b2267 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:24.901321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:24.925924 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec21ef0-aca5-4575-a13f-106f7f8b2267 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:24.961547 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42a9dc-30de-4f7c-a8a5-6a5893902231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:24.962206 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42a9dc-30de-4f7c-a8a5-6a5893902231 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:24.962483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42a9dc-30de-4f7c-a8a5-6a5893902231 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:24.962841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42a9dc-30de-4f7c-a8a5-6a5893902231 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:25.042025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42a9dc-30de-4f7c-a8a5-6a5893902231 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:25.043502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42a9dc-30de-4f7c-a8a5-6a5893902231 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:25.050397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e603beb-135a-473b-bf8d-03e91d54f06d None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:25.050889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e603beb-135a-473b-bf8d-03e91d54f06d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:25.050969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e603beb-135a-473b-bf8d-03e91d54f06d None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:25.052416 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 435/868] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:12:25.058428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b93ff1-02f7-4114-be2e-07d54101bd16 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:25.058715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b93ff1-02f7-4114-be2e-07d54101bd16 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:25.058993 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b93ff1-02f7-4114-be2e-07d54101bd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:25.077720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-90b93ff1-02f7-4114-be2e-07d54101bd16 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:25.078912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-90b93ff1-02f7-4114-be2e-07d54101bd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:25.145198 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:25.161027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 436/869] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:25 2022] POST /identity/v3/auth/tokens => generated 1264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:25.176889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 434/870] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:12:24 2022] GET /identity/v3/auth/tokens => generated 1264 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:12:25.185715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b93ff1-02f7-4114-be2e-07d54101bd16 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:25.234350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:25.293529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b93ff1-02f7-4114-be2e-07d54101bd16 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:25.329560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a963247-288b-4a31-8f31-5ecb031ec9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:25.330201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a963247-288b-4a31-8f31-5ecb031ec9ba None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:25.330482 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a963247-288b-4a31-8f31-5ecb031ec9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:25.330758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a963247-288b-4a31-8f31-5ecb031ec9ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:25.341743 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a963247-288b-4a31-8f31-5ecb031ec9ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:25.343205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a963247-288b-4a31-8f31-5ecb031ec9ba None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:25.359764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-9a963247-288b-4a31-8f31-5ecb031ec9ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:25.359764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:25.359764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:25.359764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:25.359764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:25.359764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:25.359764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:25.359764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:25.359764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:25.359764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:25.359764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:25.359764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:25.359764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:25.359764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:25.359764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:25.359764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:25.360812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:25.360812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:25.360812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:25.360812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:25.360812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:25.360812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:25.360812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:25.360812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:25.360812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:25.360812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:25.360812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:25.360812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:25.360812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:25.360812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:25.360812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:25.360812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:25.360812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:25.362910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:25.362910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:25.362910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:25.362910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 437/871] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:25.367700 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42a9dc-30de-4f7c-a8a5-6a5893902231 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:25.450826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a963247-288b-4a31-8f31-5ecb031ec9ba None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:25.498470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42a9dc-30de-4f7c-a8a5-6a5893902231 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:25.538000 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16129e31-9662-401f-8893-b7c323bbde61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:25.538663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16129e31-9662-401f-8893-b7c323bbde61 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:25.538947 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16129e31-9662-401f-8893-b7c323bbde61 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:25.539220 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16129e31-9662-401f-8893-b7c323bbde61 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:25.539868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16129e31-9662-401f-8893-b7c323bbde61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:25.540171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16129e31-9662-401f-8893-b7c323bbde61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:25.541581 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16129e31-9662-401f-8893-b7c323bbde61 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:25.555339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 435/872] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:25.560974 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16129e31-9662-401f-8893-b7c323bbde61 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:25.563453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:25.570126 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a963247-288b-4a31-8f31-5ecb031ec9ba None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:25.608802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc5070-f0ad-4a2e-a9f8-8a155806c0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:25.609197 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc5070-f0ad-4a2e-a9f8-8a155806c0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:25.609416 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc5070-f0ad-4a2e-a9f8-8a155806c0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:25.609686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc5070-f0ad-4a2e-a9f8-8a155806c0d3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:25.610269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc5070-f0ad-4a2e-a9f8-8a155806c0d3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:25.611614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc5070-f0ad-4a2e-a9f8-8a155806c0d3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:25.618305 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:25.626904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-5fbc5070-f0ad-4a2e-a9f8-8a155806c0d3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:12:25.626904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:25.626904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:25.626904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:25.626904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:25.626904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:25.626904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:25.626904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:25.626904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:12:25.626904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:25.626904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:25.626904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:25.626904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:25.626904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:25.626904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:25.626904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:25.626904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:25.627944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:25.627944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:25.627944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:25.627944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:25.627944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:25.627944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:25.627944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:25.627944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:25.627944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:25.627944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:25.627944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:25.627944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:25.627944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:25.627944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:25.627944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:25.627944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:25.628835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:25.628835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:25.628835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:25.628835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:25.628835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:25.628835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:25.628835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:25.628835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:25.628835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:25.628835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:25.628835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:25.628835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:25.628835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:12:25.628835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:25.630258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 438/873] 10.222.0.107 () {56 vars in 1131 bytes} [Tue Aug 23 23:12:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:25.639407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc5070-f0ad-4a2e-a9f8-8a155806c0d3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:25.703095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16129e31-9662-401f-8893-b7c323bbde61 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:25.741069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe2534-98f9-4325-8002-a4b053b31114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:25.741844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe2534-98f9-4325-8002-a4b053b31114 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:25.742125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe2534-98f9-4325-8002-a4b053b31114 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:25.742444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe2534-98f9-4325-8002-a4b053b31114 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:25.749426 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe2534-98f9-4325-8002-a4b053b31114 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:25.750845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe2534-98f9-4325-8002-a4b053b31114 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:25.761772 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc5070-f0ad-4a2e-a9f8-8a155806c0d3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:25.762272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9fbe2534-98f9-4325-8002-a4b053b31114 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:25.762272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:25.762272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:25.762272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:25.762272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:25.762272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:25.762272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:25.762272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:25.762272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:25.762272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:25.762272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:25.762272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:25.762272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:25.762272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:25.762272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:25.765428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:25.765428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:25.765428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:25.765428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:25.765428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:25.765428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:25.765428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:25.765428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:25.765428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:25.765428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:25.765428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:25.765428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:25.765428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:25.765428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:25.765428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:25.765428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:25.765428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:25.771562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:25.771562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:25.771562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:25.771562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:25.771562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:25.771562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:25.771562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:25.771562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:25.771562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 436/874] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:25.771562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf616d47-0e5e-4da0-a9c4-7961a304cdd5 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:25.771562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf616d47-0e5e-4da0-a9c4-7961a304cdd5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:25.773634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf616d47-0e5e-4da0-a9c4-7961a304cdd5 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:25.773634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 437/875] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:25 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:25.773634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf616d47-0e5e-4da0-a9c4-7961a304cdd5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:25.804105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900324d7-94ad-433f-9858-b027686ec515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:25.804953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900324d7-94ad-433f-9858-b027686ec515 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:25.805235 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900324d7-94ad-433f-9858-b027686ec515 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:25.805847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900324d7-94ad-433f-9858-b027686ec515 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:25.806479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900324d7-94ad-433f-9858-b027686ec515 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:25.806782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900324d7-94ad-433f-9858-b027686ec515 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:25.808148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900324d7-94ad-433f-9858-b027686ec515 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:25.812713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 439/876] 10.222.0.107 () {56 vars in 1127 bytes} [Tue Aug 23 23:12:25 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:25.813857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936f081-6083-447f-9bb3-acf4c5879170 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:25.814145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936f081-6083-447f-9bb3-acf4c5879170 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:25.814421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936f081-6083-447f-9bb3-acf4c5879170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:25.832939 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6936f081-6083-447f-9bb3-acf4c5879170 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:25.834160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6936f081-6083-447f-9bb3-acf4c5879170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:25.853458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:25.889801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:25.896509 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf616d47-0e5e-4da0-a9c4-7961a304cdd5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:25.914922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 440/877] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:25 2022] POST /identity/v3/auth/tokens => generated 1264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:25.916032 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936f081-6083-447f-9bb3-acf4c5879170 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:25.947786 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492e8e7-6bc6-47ff-ba64-8592cf80eec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:25.948776 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e8e7-6bc6-47ff-ba64-8592cf80eec6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:25.949281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e8e7-6bc6-47ff-ba64-8592cf80eec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:25.949866 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e8e7-6bc6-47ff-ba64-8592cf80eec6 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:25.950868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492e8e7-6bc6-47ff-ba64-8592cf80eec6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:25.951393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492e8e7-6bc6-47ff-ba64-8592cf80eec6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:25.953206 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492e8e7-6bc6-47ff-ba64-8592cf80eec6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:25.967660 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 438/878] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:25.973263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492e8e7-6bc6-47ff-ba64-8592cf80eec6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:26.057544 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936f081-6083-447f-9bb3-acf4c5879170 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:26.100184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e5314-d27b-4de8-92a9-3ba4ae7566e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:26.101855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e5314-d27b-4de8-92a9-3ba4ae7566e1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:26.102135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e5314-d27b-4de8-92a9-3ba4ae7566e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:26.102411 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e5314-d27b-4de8-92a9-3ba4ae7566e1 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:26.103055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e5314-d27b-4de8-92a9-3ba4ae7566e1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:26.103417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e5314-d27b-4de8-92a9-3ba4ae7566e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:26.105186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e5314-d27b-4de8-92a9-3ba4ae7566e1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:26.116633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 441/879] 10.222.0.107 () {56 vars in 1127 bytes} [Tue Aug 23 23:12:25 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:26.118504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492e8e7-6bc6-47ff-ba64-8592cf80eec6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:26.160166 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08fde5-3a57-4e56-b274-33090a168392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:26.160816 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08fde5-3a57-4e56-b274-33090a168392 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:26.161097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08fde5-3a57-4e56-b274-33090a168392 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:26.161372 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08fde5-3a57-4e56-b274-33090a168392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:26.162114 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08fde5-3a57-4e56-b274-33090a168392 None admin] RBAC: Adding query filter params (role.id=ee7f9512e7e745199ff5ed847343d11a, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=238ad0efedfd4cd89d99e2abebaeba63) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:26.162426 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08fde5-3a57-4e56-b274-33090a168392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:26.164724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08fde5-3a57-4e56-b274-33090a168392 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:26.172701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 439/880] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:12:25 2022] GET /identity/v3/role_assignments?user.id=238ad0efedfd4cd89d99e2abebaeba63&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=ee7f9512e7e745199ff5ed847343d11a => generated 610 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:26.211521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e5314-d27b-4de8-92a9-3ba4ae7566e1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:26.234190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:26.339140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e5314-d27b-4de8-92a9-3ba4ae7566e1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:26.376829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04058f31-ecc9-4bb9-a068-1e4ad1e328c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:26.377471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04058f31-ecc9-4bb9-a068-1e4ad1e328c5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:26.377744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04058f31-ecc9-4bb9-a068-1e4ad1e328c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:26.378010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04058f31-ecc9-4bb9-a068-1e4ad1e328c5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:26.378589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04058f31-ecc9-4bb9-a068-1e4ad1e328c5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:26.379952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04058f31-ecc9-4bb9-a068-1e4ad1e328c5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:26.389762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-04058f31-ecc9-4bb9-a068-1e4ad1e328c5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:12:26.389762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:26.389762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:26.389762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:26.389762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:26.389762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:26.389762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:26.389762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:26.389762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:12:26.389762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:26.389762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:26.389762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:26.389762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:26.389762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:26.389762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:26.389762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:26.389762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:26.390794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:26.390794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:26.390794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:26.390794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:26.390794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:26.390794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:26.390794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:26.390794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:26.390794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:26.390794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:26.390794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:26.390794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:26.390794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:26.390794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:26.390794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:26.390794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:26.391644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:26.391644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:26.391644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:26.391644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:26.391644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:26.391644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:26.391644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:26.391644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:26.391644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:26.391644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:26.391644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:26.391644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:26.391644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:12:26.391644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:26.391644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 442/881] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:12:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:26.396820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08fde5-3a57-4e56-b274-33090a168392 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:26.427958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:26.484517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c8c15-c8a8-480e-a64b-379962a83741 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:26.485217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c8c15-c8a8-480e-a64b-379962a83741 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:26.485688 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c8c15-c8a8-480e-a64b-379962a83741 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:26.487465 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 443/882] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:26 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:26.493747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0576689-2964-4f4f-b30a-b4fb9d761c83 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:26.494150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0576689-2964-4f4f-b30a-b4fb9d761c83 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:26.494515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0576689-2964-4f4f-b30a-b4fb9d761c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:26.513890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b0576689-2964-4f4f-b30a-b4fb9d761c83 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:26.515223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b0576689-2964-4f4f-b30a-b4fb9d761c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:26.521452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08fde5-3a57-4e56-b274-33090a168392 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:26.558059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc316f-016d-4890-85ff-89f363be1b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:26.558680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc316f-016d-4890-85ff-89f363be1b2f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:26.559107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc316f-016d-4890-85ff-89f363be1b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:26.559468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc316f-016d-4890-85ff-89f363be1b2f None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:26.560183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc316f-016d-4890-85ff-89f363be1b2f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:26.560552 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc316f-016d-4890-85ff-89f363be1b2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:26.562050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc316f-016d-4890-85ff-89f363be1b2f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:26.568128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 440/883] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:12:26 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:26.574141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc316f-016d-4890-85ff-89f363be1b2f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:26.608640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 444/884] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:26 2022] POST /identity/v3/auth/tokens => generated 1264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:12:26.677403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:26.695116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc316f-016d-4890-85ff-89f363be1b2f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:26.731121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d9771-1768-4217-99b1-f95eba34ed78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:26.731725 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d9771-1768-4217-99b1-f95eba34ed78 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:26.732043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d9771-1768-4217-99b1-f95eba34ed78 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:26.732317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d9771-1768-4217-99b1-f95eba34ed78 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:26.733018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d9771-1768-4217-99b1-f95eba34ed78 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:26.733326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d9771-1768-4217-99b1-f95eba34ed78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:26.734801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d9771-1768-4217-99b1-f95eba34ed78 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:26.744732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 441/885] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:12:26 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:26.746863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0576689-2964-4f4f-b30a-b4fb9d761c83 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:26.762738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:26.859054 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0576689-2964-4f4f-b30a-b4fb9d761c83 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:26.888868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d9771-1768-4217-99b1-f95eba34ed78 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:26.898367 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88e292-39a4-48f8-b476-74c1e9484257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:26.899647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88e292-39a4-48f8-b476-74c1e9484257 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:26.900108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88e292-39a4-48f8-b476-74c1e9484257 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:26.900523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88e292-39a4-48f8-b476-74c1e9484257 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:26.901790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88e292-39a4-48f8-b476-74c1e9484257 None admin] RBAC: Adding query filter params (interface=public, service_id=0c82e7ed3a3d4613875c7cdc5879f165, region_id=RegionOne) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:26.902248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88e292-39a4-48f8-b476-74c1e9484257 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:26.904404 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88e292-39a4-48f8-b476-74c1e9484257 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:26.914744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 445/886] 10.222.0.107 () {56 vars in 1256 bytes} [Tue Aug 23 23:12:26 2022] GET /identity/v3/endpoints?service_id=0c82e7ed3a3d4613875c7cdc5879f165&interface=public®ion_id=RegionOne => generated 195 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:26.921624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88e292-39a4-48f8-b476-74c1e9484257 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:27.025020 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d9771-1768-4217-99b1-f95eba34ed78 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:27.044816 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:27.064323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd179250-5570-459e-8f92-f9bc638eacbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:27.065359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd179250-5570-459e-8f92-f9bc638eacbd None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:27.065846 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd179250-5570-459e-8f92-f9bc638eacbd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:27.066306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd179250-5570-459e-8f92-f9bc638eacbd None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:27.067151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd179250-5570-459e-8f92-f9bc638eacbd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:27.068740 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd179250-5570-459e-8f92-f9bc638eacbd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:27.074948 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88e292-39a4-48f8-b476-74c1e9484257 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:27.096487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 442/887] 10.222.0.107 () {60 vars in 1146 bytes} [Tue Aug 23 23:12:26 2022] POST /identity/v3/services => generated 270 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:12:27.121134 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff84b96-7c38-4697-ba27-7a6ee115eb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:27.121756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff84b96-7c38-4697-ba27-7a6ee115eb53 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:27.122032 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff84b96-7c38-4697-ba27-7a6ee115eb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:27.122303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff84b96-7c38-4697-ba27-7a6ee115eb53 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:27.122975 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff84b96-7c38-4697-ba27-7a6ee115eb53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:27.124421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff84b96-7c38-4697-ba27-7a6ee115eb53 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:27.136788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 446/888] 10.222.0.107 () {56 vars in 1092 bytes} [Tue Aug 23 23:12:26 2022] GET /identity/v3/services => generated 1274 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:12:28.199588 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1afae-f416-4aec-a7b3-b685dfd43e90 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:28.200125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1afae-f416-4aec-a7b3-b685dfd43e90 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:28.200125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1afae-f416-4aec-a7b3-b685dfd43e90 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:28.201779 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 443/889] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:28.207149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cb771-aedd-4ad3-919d-ac96a39ef629 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:28.207621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cb771-aedd-4ad3-919d-ac96a39ef629 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:28.207700 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cb771-aedd-4ad3-919d-ac96a39ef629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:28.226867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-887cb771-aedd-4ad3-919d-ac96a39ef629 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:28.228064 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-887cb771-aedd-4ad3-919d-ac96a39ef629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:28.313080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc27939-89fd-4f11-94d3-59205ba1c1c3 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:28.313454 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc27939-89fd-4f11-94d3-59205ba1c1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:28.313893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc27939-89fd-4f11-94d3-59205ba1c1c3 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:28.316242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 444/890] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:28 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:28.322706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d3b21-0d81-4925-b7ce-91f5a74c4045 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:28.323130 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d3b21-0d81-4925-b7ce-91f5a74c4045 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:28.323550 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d3b21-0d81-4925-b7ce-91f5a74c4045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:28.324660 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 447/891] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:28 2022] POST /identity/v3/auth/tokens => generated 1374 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:28.349712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9c5d3b21-0d81-4925-b7ce-91f5a74c4045 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:28.351570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9c5d3b21-0d81-4925-b7ce-91f5a74c4045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:28.354548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:28.430795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 445/892] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:28 2022] POST /identity/v3/auth/tokens => generated 1374 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:12:28.597634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cb771-aedd-4ad3-919d-ac96a39ef629 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:28.668462 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:28.708300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cb771-aedd-4ad3-919d-ac96a39ef629 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:28.723805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d3b21-0d81-4925-b7ce-91f5a74c4045 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:28.745980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1af25b-0850-4b5b-b911-7f065546e6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:28.746595 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1af25b-0850-4b5b-b911-7f065546e6be None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:28.746872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1af25b-0850-4b5b-b911-7f065546e6be None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:28.747145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1af25b-0850-4b5b-b911-7f065546e6be None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:28.747808 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1af25b-0850-4b5b-b911-7f065546e6be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:28.749208 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1af25b-0850-4b5b-b911-7f065546e6be None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:28.768063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 448/893] 10.222.0.107 () {60 vars in 1146 bytes} [Tue Aug 23 23:12:28 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:28.846025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d3b21-0d81-4925-b7ce-91f5a74c4045 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:28.894815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d40e0-601c-404a-8e97-4340be129918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:28.895366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d40e0-601c-404a-8e97-4340be129918 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:28.895638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d40e0-601c-404a-8e97-4340be129918 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:28.895911 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d40e0-601c-404a-8e97-4340be129918 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:28.899988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:28.915244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d40e0-601c-404a-8e97-4340be129918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:28.920951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-cf2d40e0-601c-404a-8e97-4340be129918 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:12:28.920951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:28.920951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:28.920951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:28.920951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:28.920951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:28.920951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:28.920951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:28.920951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:28.920951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:28.920951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:28.920951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:28.920951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:28.920951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:28.920951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:28.920951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:28.921920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:28.921920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:28.921920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:28.921920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:28.921920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:28.921920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:28.921920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:28.921920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:28.921920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:28.921920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:28.921920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:28.921920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:28.921920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:28.921920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:28.921920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:28.921920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:28.922761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:28.922761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:28.922761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:28.922761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:28.922761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:28.922761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:28.922761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:28.922761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:28.922761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:28.922761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:28.922761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:12:28.922761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:28.922761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 446/894] 10.222.0.107 () {56 vars in 1125 bytes} [Tue Aug 23 23:12:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:28.930329 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1af25b-0850-4b5b-b911-7f065546e6be None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:29.039674 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1af25b-0850-4b5b-b911-7f065546e6be None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:29.067122 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:29.076702 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74bff6-45af-4f40-9bf0-04c2df1efbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:29.077324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74bff6-45af-4f40-9bf0-04c2df1efbde None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:29.077889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74bff6-45af-4f40-9bf0-04c2df1efbde None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:29.078442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74bff6-45af-4f40-9bf0-04c2df1efbde None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:29.079467 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74bff6-45af-4f40-9bf0-04c2df1efbde None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:29.080346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74bff6-45af-4f40-9bf0-04c2df1efbde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:29.081794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74bff6-45af-4f40-9bf0-04c2df1efbde None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:29.092543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 449/895] 10.222.0.107 () {56 vars in 1120 bytes} [Tue Aug 23 23:12:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:29.097764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d40e0-601c-404a-8e97-4340be129918 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:29.196405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2c1e4-4d87-4e1d-aca4-01bb560d7b05 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:29.196579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2c1e4-4d87-4e1d-aca4-01bb560d7b05 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:29.197207 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2c1e4-4d87-4e1d-aca4-01bb560d7b05 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:29.198624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 450/896] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:12:29.204141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a09f36-56da-4434-a2a5-30b0a37ce292 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:29.204416 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a09f36-56da-4434-a2a5-30b0a37ce292 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:29.204983 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a09f36-56da-4434-a2a5-30b0a37ce292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:29.218397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d40e0-601c-404a-8e97-4340be129918 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:29.226528 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-33a09f36-56da-4434-a2a5-30b0a37ce292 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:29.228448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-33a09f36-56da-4434-a2a5-30b0a37ce292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:29.259874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eb15a-3135-4a4e-85b1-648e81c35727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:29.260553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eb15a-3135-4a4e-85b1-648e81c35727 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:29.260870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eb15a-3135-4a4e-85b1-648e81c35727 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:29.261146 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eb15a-3135-4a4e-85b1-648e81c35727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:29.275191 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9eb15a-3135-4a4e-85b1-648e81c35727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:29.276766 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9eb15a-3135-4a4e-85b1-648e81c35727 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:29.295254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9f9eb15a-3135-4a4e-85b1-648e81c35727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:29.295254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:29.295254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:29.295254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:29.295254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:29.295254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:29.295254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:29.295254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:29.295254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:29.295254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:29.295254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:29.295254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:29.295254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:29.295254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:29.295254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:29.295254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:29.296479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:29.296479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:29.296479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:29.296479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:29.296479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:29.296479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:29.296479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:29.296479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:29.296479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:29.296479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:29.296479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:29.296479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:29.296479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:29.296479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:29.296479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:29.296479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:29.296479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:29.297413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:29.297413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:29.297413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:29.301144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 447/897] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:29.302361 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29849177-5e2d-48bd-887e-5a8ee4ebe1cd None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:29.302645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29849177-5e2d-48bd-887e-5a8ee4ebe1cd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:29.302919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29849177-5e2d-48bd-887e-5a8ee4ebe1cd None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:29.305337 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 448/898] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:29.306088 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29849177-5e2d-48bd-887e-5a8ee4ebe1cd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:29.320656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 451/899] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:29 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:12:29.320656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c57507-ac8c-4322-a9dc-b3287563efc6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:29.320656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c57507-ac8c-4322-a9dc-b3287563efc6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:29.320656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c57507-ac8c-4322-a9dc-b3287563efc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:29.341150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b2c57507-ac8c-4322-a9dc-b3287563efc6 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:29.342634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b2c57507-ac8c-4322-a9dc-b3287563efc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:29.370591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:29.428926 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 452/900] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:29 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:29.439853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29849177-5e2d-48bd-887e-5a8ee4ebe1cd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:29.478268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf27cb-2bbb-470d-999e-f9cf6474a007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:29.478887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf27cb-2bbb-470d-999e-f9cf6474a007 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:29.479166 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf27cb-2bbb-470d-999e-f9cf6474a007 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:29.479447 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf27cb-2bbb-470d-999e-f9cf6474a007 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:29.480097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf27cb-2bbb-470d-999e-f9cf6474a007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:29.480400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf27cb-2bbb-470d-999e-f9cf6474a007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:29.481864 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf27cb-2bbb-470d-999e-f9cf6474a007 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:29.499452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 449/901] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:29.500915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c57507-ac8c-4322-a9dc-b3287563efc6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:29.554591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:29.610767 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c57507-ac8c-4322-a9dc-b3287563efc6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:29.629982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf27cb-2bbb-470d-999e-f9cf6474a007 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:29.653073 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c26005-6720-49ff-a092-3dff5bb10361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:29.653715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c26005-6720-49ff-a092-3dff5bb10361 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:29.653990 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c26005-6720-49ff-a092-3dff5bb10361 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:29.654257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c26005-6720-49ff-a092-3dff5bb10361 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:29.661723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c26005-6720-49ff-a092-3dff5bb10361 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:29.663902 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c26005-6720-49ff-a092-3dff5bb10361 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:29.675895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-e0c26005-6720-49ff-a092-3dff5bb10361 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:12:29.675895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:29.675895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:29.675895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:29.675895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:29.675895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:29.675895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:29.675895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:29.675895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:29.675895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:29.675895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:29.675895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:29.675895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:29.675895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:29.675895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:29.675895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:29.676890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:29.676890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:29.676890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:29.676890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:29.676890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:29.676890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:29.676890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:29.676890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:29.676890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:29.676890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:29.676890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:29.676890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:29.676890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:29.676890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:29.676890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:29.676890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:29.676890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:29.676890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:29.677914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:29.677914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:29.677914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:29.677914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:29.677914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:29.677914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:29.677914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:29.677914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:29.677914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:12:29.677914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:29.677914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 453/902] 10.222.0.107 () {56 vars in 1122 bytes} [Tue Aug 23 23:12:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:29.684935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c26005-6720-49ff-a092-3dff5bb10361 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:29.752989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf27cb-2bbb-470d-999e-f9cf6474a007 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:29.763891 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:29.793349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c26005-6720-49ff-a092-3dff5bb10361 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:29.793738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321ff33-6514-4bd3-9581-45dbca222769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:29.794626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321ff33-6514-4bd3-9581-45dbca222769 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:29.794892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321ff33-6514-4bd3-9581-45dbca222769 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:29.795170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321ff33-6514-4bd3-9581-45dbca222769 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:29.795728 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321ff33-6514-4bd3-9581-45dbca222769 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:29.797126 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321ff33-6514-4bd3-9581-45dbca222769 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:29.803206 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:29.806222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9321ff33-6514-4bd3-9581-45dbca222769 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:12:29.806222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:29.806222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:29.806222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:29.806222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:29.806222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:29.806222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:29.806222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:29.806222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:12:29.806222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:29.806222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:29.806222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:29.806222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:29.806222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:29.806222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:29.806222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:29.807164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:29.807164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:29.807164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:29.807164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:29.807164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:29.807164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:29.807164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:29.807164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:29.807164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:29.807164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:29.807164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:29.807164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:29.807164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:29.807164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:29.807164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:29.807164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:29.807164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:29.808095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:29.808095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:29.808095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:29.808095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:29.808095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:29.808095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:29.808095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:29.808095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:29.808095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:29.808095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:29.808095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:29.808095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:29.808095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:12:29.808095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:29.808095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 450/903] 10.222.0.107 () {56 vars in 1137 bytes} [Tue Aug 23 23:12:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:29.809744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321ff33-6514-4bd3-9581-45dbca222769 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:29.841529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf278c-9d0e-4c7b-8421-90351703d34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:29.842272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf278c-9d0e-4c7b-8421-90351703d34b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:29.842400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf278c-9d0e-4c7b-8421-90351703d34b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:29.842697 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf278c-9d0e-4c7b-8421-90351703d34b None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:29.843355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf278c-9d0e-4c7b-8421-90351703d34b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:29.843728 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf278c-9d0e-4c7b-8421-90351703d34b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:29.845103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf278c-9d0e-4c7b-8421-90351703d34b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:29.865371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 454/904] 10.222.0.107 () {56 vars in 1154 bytes} [Tue Aug 23 23:12:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:29.866234 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf278c-9d0e-4c7b-8421-90351703d34b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:29.931100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321ff33-6514-4bd3-9581-45dbca222769 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:29.971313 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109abfcb-388d-439e-95ac-4d644cea9391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:29.971956 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109abfcb-388d-439e-95ac-4d644cea9391 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:29.972389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109abfcb-388d-439e-95ac-4d644cea9391 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:29.972701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109abfcb-388d-439e-95ac-4d644cea9391 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:29.973286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109abfcb-388d-439e-95ac-4d644cea9391 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:29.974645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109abfcb-388d-439e-95ac-4d644cea9391 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:29.983907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-109abfcb-388d-439e-95ac-4d644cea9391 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:12:29.983907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:29.983907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:29.983907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:29.983907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:29.983907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:29.983907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:29.983907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:29.983907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:12:29.983907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:29.983907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:29.983907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:29.983907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:29.983907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:29.983907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:29.983907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:29.983907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:29.985081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:29.985081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:29.985081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:29.985081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:29.985081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:29.985081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:29.985081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:29.985081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:29.985081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:29.985081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:29.985081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:29.985081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:29.985081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:29.985081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:29.985081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:29.985081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:29.985963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:29.985963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:29.985963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:29.985963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:29.985963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:29.985963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:29.985963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:29.985963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:29.985963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:29.985963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:29.985963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:29.985963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:29.985963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:12:29.985963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:29.985963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 451/905] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:12:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:29.986770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109abfcb-388d-439e-95ac-4d644cea9391 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:29.991541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf278c-9d0e-4c7b-8421-90351703d34b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:30.033471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:30.035087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a35aa-643d-4fb3-b5fc-a9ea94dbc4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:30.035693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a35aa-643d-4fb3-b5fc-a9ea94dbc4ad None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:30.035976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a35aa-643d-4fb3-b5fc-a9ea94dbc4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:30.036321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a35aa-643d-4fb3-b5fc-a9ea94dbc4ad None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:30.036956 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a35aa-643d-4fb3-b5fc-a9ea94dbc4ad None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:30.037262 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a35aa-643d-4fb3-b5fc-a9ea94dbc4ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:30.040169 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a35aa-643d-4fb3-b5fc-a9ea94dbc4ad None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:30.051407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 455/906] 10.222.0.107 () {56 vars in 1131 bytes} [Tue Aug 23 23:12:29 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:30.052338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a35aa-643d-4fb3-b5fc-a9ea94dbc4ad None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:30.089271 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:30.119793 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109abfcb-388d-439e-95ac-4d644cea9391 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:30.166589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c07b5-9517-43fd-b5af-69c8bcc789f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:30.167742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c07b5-9517-43fd-b5af-69c8bcc789f1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:30.168466 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c07b5-9517-43fd-b5af-69c8bcc789f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:30.169220 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c07b5-9517-43fd-b5af-69c8bcc789f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:30.172270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a35aa-643d-4fb3-b5fc-a9ea94dbc4ad None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:30.207705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f141c-ea1e-4cc7-b552-af6d89ce74f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:30.208316 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f141c-ea1e-4cc7-b552-af6d89ce74f9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:30.208624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f141c-ea1e-4cc7-b552-af6d89ce74f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:30.208901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f141c-ea1e-4cc7-b552-af6d89ce74f9 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:30.210258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f141c-ea1e-4cc7-b552-af6d89ce74f9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:30.210607 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f141c-ea1e-4cc7-b552-af6d89ce74f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:30.212820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f141c-ea1e-4cc7-b552-af6d89ce74f9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:30.219537 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 456/907] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:12:30 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:30.220718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f141c-ea1e-4cc7-b552-af6d89ce74f9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:30.248409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c07b5-9517-43fd-b5af-69c8bcc789f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:30.250932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c07b5-9517-43fd-b5af-69c8bcc789f1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:30.290518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:30.327918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:30.336520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f141c-ea1e-4cc7-b552-af6d89ce74f9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:30.369140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 452/908] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:12:29 2022] GET /identity/v3/auth/tokens => generated 1476 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:12:30.370030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c07b5-9517-43fd-b5af-69c8bcc789f1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:30.376468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb0594-1f0e-4032-8c4f-2b9c08f4ecad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:30.377112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb0594-1f0e-4032-8c4f-2b9c08f4ecad None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:30.377385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb0594-1f0e-4032-8c4f-2b9c08f4ecad None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:30.377649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb0594-1f0e-4032-8c4f-2b9c08f4ecad None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:30.378276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb0594-1f0e-4032-8c4f-2b9c08f4ecad None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:30.378574 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb0594-1f0e-4032-8c4f-2b9c08f4ecad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:30.379931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb0594-1f0e-4032-8c4f-2b9c08f4ecad None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:30.386146 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 457/909] 10.222.0.107 () {56 vars in 1131 bytes} [Tue Aug 23 23:12:30 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:30.389629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb0594-1f0e-4032-8c4f-2b9c08f4ecad None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:30.488777 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c07b5-9517-43fd-b5af-69c8bcc789f1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:30.509246 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb0594-1f0e-4032-8c4f-2b9c08f4ecad None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:30.528609 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799bd66-b4d7-4263-baed-fb668cf801b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:30.529236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799bd66-b4d7-4263-baed-fb668cf801b8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:30.529504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799bd66-b4d7-4263-baed-fb668cf801b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:30.530208 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799bd66-b4d7-4263-baed-fb668cf801b8 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:30.530845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799bd66-b4d7-4263-baed-fb668cf801b8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:30.531150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799bd66-b4d7-4263-baed-fb668cf801b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:30.532506 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799bd66-b4d7-4263-baed-fb668cf801b8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:30.534953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:30.541548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 453/910] 10.222.0.107 () {56 vars in 1119 bytes} [Tue Aug 23 23:12:30 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:30.542666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799bd66-b4d7-4263-baed-fb668cf801b8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:30.547459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe53ee-4759-4253-aeca-40de223d581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:30.548103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe53ee-4759-4253-aeca-40de223d581a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:30.548380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe53ee-4759-4253-aeca-40de223d581a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:30.548686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe53ee-4759-4253-aeca-40de223d581a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:30.560075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe53ee-4759-4253-aeca-40de223d581a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:30.561568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe53ee-4759-4253-aeca-40de223d581a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:30.577332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-90fe53ee-4759-4253-aeca-40de223d581a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:30.577332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:30.577332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:30.577332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:30.577332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:30.577332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:30.577332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:30.577332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:30.577332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:30.577332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:30.577332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:30.577332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:30.577332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:30.577332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:30.577332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:30.577332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:30.578333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:30.578333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:30.578333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:30.578333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:30.578333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:30.578333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:30.578333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:30.578333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:30.578333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:30.578333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:30.578333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:30.578333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:30.578333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:30.578333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:30.578333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:30.578333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:30.578333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:30.579263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:30.579263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:30.579263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:30.579263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 458/911] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:30.579263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe53ee-4759-4253-aeca-40de223d581a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:30.594007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:30.660613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799bd66-b4d7-4263-baed-fb668cf801b8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:30.691015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe53ee-4759-4253-aeca-40de223d581a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:30.706113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7e3f1-ea39-450f-a1b8-658b583a0978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:30.706783 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7e3f1-ea39-450f-a1b8-658b583a0978 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:30.707061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7e3f1-ea39-450f-a1b8-658b583a0978 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:30.707331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7e3f1-ea39-450f-a1b8-658b583a0978 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:30.709372 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7e3f1-ea39-450f-a1b8-658b583a0978 None admin] RBAC: Adding query filter params (interface=public, service_id=1cc8ce7738f24756b09cd6f3ff4f5ff5, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:30.709766 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7e3f1-ea39-450f-a1b8-658b583a0978 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:30.712257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7e3f1-ea39-450f-a1b8-658b583a0978 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:30.723746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 454/912] 10.222.0.107 () {56 vars in 1256 bytes} [Tue Aug 23 23:12:30 2022] GET /identity/v3/endpoints?service_id=1cc8ce7738f24756b09cd6f3ff4f5ff5&interface=public®ion_id=RegionOne => generated 195 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:30.723746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7e3f1-ea39-450f-a1b8-658b583a0978 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:30.749590 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116079b-f5d1-45e5-b139-9922c17ebe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:30.750668 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116079b-f5d1-45e5-b139-9922c17ebe67 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:30.751222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116079b-f5d1-45e5-b139-9922c17ebe67 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:30.751500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116079b-f5d1-45e5-b139-9922c17ebe67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:30.752416 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116079b-f5d1-45e5-b139-9922c17ebe67 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:30.755335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116079b-f5d1-45e5-b139-9922c17ebe67 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:30.779900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 459/913] 10.222.0.107 () {60 vars in 1149 bytes} [Tue Aug 23 23:12:30 2022] POST /identity/v3/endpoints => generated 348 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:30.780869 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116079b-f5d1-45e5-b139-9922c17ebe67 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:30.802939 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:30.850242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7e3f1-ea39-450f-a1b8-658b583a0978 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:30.877981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:30.899005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a8b48-252f-4674-8997-c95a1e280bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:30.899625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a8b48-252f-4674-8997-c95a1e280bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:30.899901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a8b48-252f-4674-8997-c95a1e280bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:30.900168 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a8b48-252f-4674-8997-c95a1e280bb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:30.900933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a8b48-252f-4674-8997-c95a1e280bb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:30.901232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a8b48-252f-4674-8997-c95a1e280bb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:30.902630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a8b48-252f-4674-8997-c95a1e280bb1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:30.921260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 455/914] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:30.922564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3337c0b-f189-4aef-81a8-4fa53565cd7a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:30.922853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3337c0b-f189-4aef-81a8-4fa53565cd7a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:30.923126 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3337c0b-f189-4aef-81a8-4fa53565cd7a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:30.924532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 456/915] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:30.925222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3337c0b-f189-4aef-81a8-4fa53565cd7a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:30.932802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116079b-f5d1-45e5-b139-9922c17ebe67 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:30.977801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcaf633-7f86-441c-8dfb-3fe07c4ae354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:30.978424 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaf633-7f86-441c-8dfb-3fe07c4ae354 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:30.978697 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaf633-7f86-441c-8dfb-3fe07c4ae354 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:30.978974 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaf633-7f86-441c-8dfb-3fe07c4ae354 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:30.979591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcaf633-7f86-441c-8dfb-3fe07c4ae354 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:30.980992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcaf633-7f86-441c-8dfb-3fe07c4ae354 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:31.001295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 460/916] 10.222.0.107 () {56 vars in 1092 bytes} [Tue Aug 23 23:12:30 2022] GET /identity/v3/services => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:12:31.001295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfe3ec-8697-4b8d-8537-b0b784931d8b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:31.001295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfe3ec-8697-4b8d-8537-b0b784931d8b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:31.001295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfe3ec-8697-4b8d-8537-b0b784931d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:31.019526 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7abfe3ec-8697-4b8d-8537-b0b784931d8b None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:31.021120 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7abfe3ec-8697-4b8d-8537-b0b784931d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:31.046632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3337c0b-f189-4aef-81a8-4fa53565cd7a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:31.071855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:31.092186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ade54-1993-47e8-8961-19022396cc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:31.092966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ade54-1993-47e8-8961-19022396cc2e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:31.093361 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ade54-1993-47e8-8961-19022396cc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:31.093743 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ade54-1993-47e8-8961-19022396cc2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:31.101737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ade54-1993-47e8-8961-19022396cc2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:31.103396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ade54-1993-47e8-8961-19022396cc2e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:31.113537 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 461/917] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:30 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:31.120625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-198ade54-1993-47e8-8961-19022396cc2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:31.120625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:31.120625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:31.120625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:31.120625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:31.120625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:31.120625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:31.120625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:31.120625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:31.120625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:31.120625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:31.120625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:31.120625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:31.120625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:31.120625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:31.121583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:31.121583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:31.121583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:31.121583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:31.121583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:31.121583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:31.121583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:31.121583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:31.121583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:31.121583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:31.121583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:31.121583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:31.121583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:31.121583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:31.121583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:31.121583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:31.121583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:31.122485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:31.122485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:31.122485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:31.122485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:31.122485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:31.122485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:31.122485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:31.122485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:31.122485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 457/918] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:31.125775 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfe3ec-8697-4b8d-8537-b0b784931d8b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:31.190576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:31.241477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfe3ec-8697-4b8d-8537-b0b784931d8b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:31.282046 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229484b-3668-406e-be1a-5bcbba4135dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:31.282660 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229484b-3668-406e-be1a-5bcbba4135dc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:31.282937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229484b-3668-406e-be1a-5bcbba4135dc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:31.283207 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229484b-3668-406e-be1a-5bcbba4135dc None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:31.283987 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229484b-3668-406e-be1a-5bcbba4135dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:31.284384 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229484b-3668-406e-be1a-5bcbba4135dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:31.285976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229484b-3668-406e-be1a-5bcbba4135dc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:31.299671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 462/919] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:31.306049 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ade54-1993-47e8-8961-19022396cc2e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:31.401164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229484b-3668-406e-be1a-5bcbba4135dc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:31.418771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ade54-1993-47e8-8961-19022396cc2e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:31.455992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2142c-517a-428f-8a8f-016d990f65f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:31.456624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2142c-517a-428f-8a8f-016d990f65f7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:31.456898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2142c-517a-428f-8a8f-016d990f65f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:31.457168 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2142c-517a-428f-8a8f-016d990f65f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:31.457891 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2142c-517a-428f-8a8f-016d990f65f7 None admin] RBAC: Adding query filter params (role.id=66e20b7ea4884a8891f2561c6efe905f, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=238ad0efedfd4cd89d99e2abebaeba63) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:31.458197 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2142c-517a-428f-8a8f-016d990f65f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:31.459614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2142c-517a-428f-8a8f-016d990f65f7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:31.465884 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 458/920] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:12:31 2022] GET /identity/v3/role_assignments?user.id=238ad0efedfd4cd89d99e2abebaeba63&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=66e20b7ea4884a8891f2561c6efe905f => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:31.526276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229484b-3668-406e-be1a-5bcbba4135dc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:31.550638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:31.569612 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe32b4-0f8e-48dc-ab0d-3fd3912a32f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:31.570703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe32b4-0f8e-48dc-ab0d-3fd3912a32f5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:31.571197 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe32b4-0f8e-48dc-ab0d-3fd3912a32f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:31.571663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe32b4-0f8e-48dc-ab0d-3fd3912a32f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:31.572449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe32b4-0f8e-48dc-ab0d-3fd3912a32f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:31.574438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe32b4-0f8e-48dc-ab0d-3fd3912a32f5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:31.585321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-aefe32b4-0f8e-48dc-ab0d-3fd3912a32f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:12:31.585321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:31.585321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:31.585321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:31.585321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:31.585321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:31.585321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:31.585321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:31.585321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:12:31.585321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:31.585321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:31.585321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:31.585321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:31.585321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:31.585321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:31.585321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:31.585321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:31.586498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:31.586498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:31.586498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:31.586498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:31.586498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:31.586498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:31.586498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:31.586498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:31.586498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:31.586498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:31.586498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:31.586498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:31.586498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:31.586498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:31.586498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:31.586498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:31.587374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:31.587374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:31.587374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:31.587374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:31.587374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:31.587374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:31.587374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:31.587374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:31.587374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:31.587374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:31.587374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:31.587374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:31.587374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:12:31.587374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:31.595126 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 463/921] 10.222.0.107 () {56 vars in 1131 bytes} [Tue Aug 23 23:12:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:31.597029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2142c-517a-428f-8a8f-016d990f65f7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:31.649671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:31.709001 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2142c-517a-428f-8a8f-016d990f65f7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:31.744459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db18a7-f68f-4860-9f5f-158ad30c95a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:31.745488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db18a7-f68f-4860-9f5f-158ad30c95a3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:31.746013 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db18a7-f68f-4860-9f5f-158ad30c95a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:31.746489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db18a7-f68f-4860-9f5f-158ad30c95a3 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:31.747323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db18a7-f68f-4860-9f5f-158ad30c95a3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:31.747827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db18a7-f68f-4860-9f5f-158ad30c95a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:31.749412 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db18a7-f68f-4860-9f5f-158ad30c95a3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:31.760281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 459/922] 10.222.0.107 () {56 vars in 1127 bytes} [Tue Aug 23 23:12:31 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:31.761972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe32b4-0f8e-48dc-ab0d-3fd3912a32f5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:31.867538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe32b4-0f8e-48dc-ab0d-3fd3912a32f5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:31.907389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe8bd-d893-4d23-b8bd-017f195d38ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:31.908005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe8bd-d893-4d23-b8bd-017f195d38ce None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:31.908283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe8bd-d893-4d23-b8bd-017f195d38ce None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:31.908558 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbe8bd-d893-4d23-b8bd-017f195d38ce None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:31.909221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbe8bd-d893-4d23-b8bd-017f195d38ce None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:31.909522 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbe8bd-d893-4d23-b8bd-017f195d38ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:31.910886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbe8bd-d893-4d23-b8bd-017f195d38ce None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:31.917263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 464/923] 10.222.0.107 () {56 vars in 1127 bytes} [Tue Aug 23 23:12:31 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:31.923640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db18a7-f68f-4860-9f5f-158ad30c95a3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:32.034682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db18a7-f68f-4860-9f5f-158ad30c95a3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:32.045275 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:32.073202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62a1b9-5211-4e1c-afc3-b3a95e40571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:32.073841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62a1b9-5211-4e1c-afc3-b3a95e40571a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:32.074102 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62a1b9-5211-4e1c-afc3-b3a95e40571a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:32.074341 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62a1b9-5211-4e1c-afc3-b3a95e40571a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:32.075050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62a1b9-5211-4e1c-afc3-b3a95e40571a None admin] RBAC: Adding query filter params (interface=public, service_id=b3c91ec56dae4199a9d5a359e9ad7419, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:32.075358 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62a1b9-5211-4e1c-afc3-b3a95e40571a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:32.076766 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62a1b9-5211-4e1c-afc3-b3a95e40571a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:32.082539 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 460/924] 10.222.0.107 () {56 vars in 1256 bytes} [Tue Aug 23 23:12:31 2022] GET /identity/v3/endpoints?service_id=b3c91ec56dae4199a9d5a359e9ad7419&interface=public®ion_id=RegionOne => generated 195 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:32.089754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe8bd-d893-4d23-b8bd-017f195d38ce None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:32.152973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:32.199543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbe8bd-d893-4d23-b8bd-017f195d38ce None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:32.235379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94982d-bb3f-475a-b53f-ee6fc7f5142b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:32.235989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94982d-bb3f-475a-b53f-ee6fc7f5142b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:32.236266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94982d-bb3f-475a-b53f-ee6fc7f5142b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:32.236538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94982d-bb3f-475a-b53f-ee6fc7f5142b None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:32.237171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94982d-bb3f-475a-b53f-ee6fc7f5142b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:32.238528 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94982d-bb3f-475a-b53f-ee6fc7f5142b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:32.245515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 465/925] 10.222.0.107 () {56 vars in 1092 bytes} [Tue Aug 23 23:12:32 2022] GET /identity/v3/services => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:12:32.873683 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f46a9-84e9-493b-b932-da2fa85baec0 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:32.874205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f46a9-84e9-493b-b932-da2fa85baec0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:32.874314 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f46a9-84e9-493b-b932-da2fa85baec0 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:32.875818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 461/926] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:32.882647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574b189-7ada-4192-9c2b-d5e28272c193 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:32.883116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574b189-7ada-4192-9c2b-d5e28272c193 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:32.883409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574b189-7ada-4192-9c2b-d5e28272c193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:32.903169 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4574b189-7ada-4192-9c2b-d5e28272c193 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:32.904477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4574b189-7ada-4192-9c2b-d5e28272c193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:32.979166 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 466/927] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:32 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:33.183408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5f73d-0bfc-48a8-bd9b-7f2ed2a214cd None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:33.183586 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5f73d-0bfc-48a8-bd9b-7f2ed2a214cd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:33.183945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5f73d-0bfc-48a8-bd9b-7f2ed2a214cd None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:33.185615 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 462/928] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:33.191169 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad20c62-ea0b-45ac-a71c-7bf3b22b1b17 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:33.191457 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad20c62-ea0b-45ac-a71c-7bf3b22b1b17 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:33.191726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad20c62-ea0b-45ac-a71c-7bf3b22b1b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:33.210868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6ad20c62-ea0b-45ac-a71c-7bf3b22b1b17 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:33.212174 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6ad20c62-ea0b-45ac-a71c-7bf3b22b1b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:33.251027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:33.259850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5f73d-0bfc-48a8-bd9b-7f2ed2a214cd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:33.289393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 467/929] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:33 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:33.375516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5f73d-0bfc-48a8-bd9b-7f2ed2a214cd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:33.414171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fa949-5683-4327-b509-613eef051eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:33.414767 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fa949-5683-4327-b509-613eef051eb8 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:33.415041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fa949-5683-4327-b509-613eef051eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:33.415364 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fa949-5683-4327-b509-613eef051eb8 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:33.416011 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fa949-5683-4327-b509-613eef051eb8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:33.417516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fa949-5683-4327-b509-613eef051eb8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:33.420346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: WARNING keystone.server.flask.common [None req-275fa949-5683-4327-b509-613eef051eb8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 23:12:33.439737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.sql.core [None req-275fa949-5683-4327-b509-613eef051eb8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 23:12:33.439737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 23:12:33.439737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [parameters: {'id': 'f757516d80c245f8abde8ee56b6b73ec', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 23:12:33.439737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81437) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 23:12:33.447193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-275fa949-5683-4327-b509-613eef051eb8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f757516d80c245f8abde8ee56b6b73ec.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f757516d80c245f8abde8ee56b6b73ec. Aug 23 23:12:33.447193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:33.447193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:12:33.447193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:12:33.447193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:12:33.447193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:12:33.447193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:12:33.447193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:12:33.447193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:12:33.447193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:12:33.447193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:12:33.447193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:12:33.447193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:12:33.447991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application result.read() Aug 23 23:12:33.447991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:12:33.447991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:12:33.447991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:12:33.447991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:12:33.447991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:12:33.447991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:12:33.447991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:12:33.447991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:12:33.447991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 23:12:33.447991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:33.447991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 23:12:33.447991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:33.447991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:33.447991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 23:12:33.447991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 23:12:33.447991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 23 23:12:33.447991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 23 23:12:33.449397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:12:33.449397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:12:33.449397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 23:12:33.449397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application yield resource Aug 23 23:12:33.449397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:12:33.449397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:12:33.449397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 23:12:33.449397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 23:12:33.449397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 23:12:33.449397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 23:12:33.449397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 23:12:33.449397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise self.value Aug 23 23:12:33.449397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 23:12:33.449397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 23:12:33.449397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 23:12:33.449397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application session.commit() Aug 23 23:12:33.449397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 23:12:33.450747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 23:12:33.450747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 23:12:33.450747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 23:12:33.450747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 23:12:33.450747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.session.flush() Aug 23 23:12:33.450747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 23:12:33.450747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 23:12:33.450747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 23:12:33.450747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 23:12:33.450747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 23:12:33.450747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application compat.raise_( Aug 23 23:12:33.450747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:12:33.450747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception Aug 23 23:12:33.450747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 23:12:33.450747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 23:12:33.450747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 23:12:33.450747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 23:12:33.451648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 23:12:33.451648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 23:12:33.451648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 23:12:33.451648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 23:12:33.451648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 23:12:33.451648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 23:12:33.451648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 23:12:33.451648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 23:12:33.451648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 23:12:33.451648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 23:12:33.451648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 23:12:33.451648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 23:12:33.451648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 23:12:33.451648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 23:12:33.451648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 23:12:33.453056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 23:12:33.453056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:12:33.453056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception Aug 23 23:12:33.453056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:12:33.453056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:12:33.453056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:12:33.453056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:12:33.453056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:12:33.453056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:12:33.453056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:12:33.453056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:12:33.453056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:12:33.453056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:12:33.453056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:12:33.453056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application result.read() Aug 23 23:12:33.453056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:12:33.453056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:12:33.454723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:12:33.454723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:12:33.454723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:12:33.454723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:12:33.454723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:12:33.454723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:12:33.454723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 23:12:33.454723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 23:12:33.454723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [parameters: {'id': 'f757516d80c245f8abde8ee56b6b73ec', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 23:12:33.454723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 23:12:33.454723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:33.454723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:33.454723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:33.454723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:33.454723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 23 23:12:33.455787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 23 23:12:33.455787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 23:12:33.455787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 23:12:33.455787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 23 23:12:33.455787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:33.455787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:33.455787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:33.455787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:33.455787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:33.455787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:33.455787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:33.455787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:33.455787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:33.455787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:33.455787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:33.455787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:33.455787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:33.458829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:33.458829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 23 23:12:33.458829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 23 23:12:33.458829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:33.458829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:33.458829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 23 23:12:33.458829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 23 23:12:33.458829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f757516d80c245f8abde8ee56b6b73ec. Aug 23 23:12:33.458829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:33.458829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 463/930] 10.222.0.107 () {60 vars in 1145 bytes} [Tue Aug 23 23:12:33 2022] POST /identity/v3/projects => generated 262 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:33.460908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad20c62-ea0b-45ac-a71c-7bf3b22b1b17 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:33.518649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376344c-93b8-402f-9235-d312a83fbff7 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:33.518867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376344c-93b8-402f-9235-d312a83fbff7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:33.519087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376344c-93b8-402f-9235-d312a83fbff7 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:33.523636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 464/931] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:33 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:12:33.528448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5159d-0610-436a-8069-49130537cf86 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:33.528805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5159d-0610-436a-8069-49130537cf86 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:33.529083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5159d-0610-436a-8069-49130537cf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:33.551551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1ec5159d-0610-436a-8069-49130537cf86 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:33.553180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1ec5159d-0610-436a-8069-49130537cf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:33.566975 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad20c62-ea0b-45ac-a71c-7bf3b22b1b17 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:33.582107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:33.608885 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f7d9b-f79c-49f9-8432-4a51329a5ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:33.609679 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f7d9b-f79c-49f9-8432-4a51329a5ccd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:33.609958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f7d9b-f79c-49f9-8432-4a51329a5ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:33.610230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f7d9b-f79c-49f9-8432-4a51329a5ccd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:33.617973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f7d9b-f79c-49f9-8432-4a51329a5ccd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:33.619411 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f7d9b-f79c-49f9-8432-4a51329a5ccd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:33.630541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-507f7d9b-f79c-49f9-8432-4a51329a5ccd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:33.630541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:33.630541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:33.630541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:33.630541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:33.630541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:33.630541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:33.630541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:33.630541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:33.630541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:33.630541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:33.630541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:33.630541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:33.630541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:33.630541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:33.631484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:33.631484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:33.631484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:33.631484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:33.631484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:33.631484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:33.631484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:33.631484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:33.631484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:33.631484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:33.631484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:33.631484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:33.631484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:33.631484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:33.631484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:33.631484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:33.631484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:33.633190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:33.633190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:33.633190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:33.633190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:33.633190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:33.633190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:33.633190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:33.633190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:33.633190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 468/932] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:33.633190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f7d9b-f79c-49f9-8432-4a51329a5ccd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:33.634097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 465/933] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:33 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:12:33.641640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5159d-0610-436a-8069-49130537cf86 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:33.674647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:33.762322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f7d9b-f79c-49f9-8432-4a51329a5ccd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:33.782125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5159d-0610-436a-8069-49130537cf86 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:33.809973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544009a2-08b6-4604-a84b-9b0a8f1089f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:33.810611 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544009a2-08b6-4604-a84b-9b0a8f1089f1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:33.810887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544009a2-08b6-4604-a84b-9b0a8f1089f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:33.811620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544009a2-08b6-4604-a84b-9b0a8f1089f1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:33.812217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544009a2-08b6-4604-a84b-9b0a8f1089f1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:33.814078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544009a2-08b6-4604-a84b-9b0a8f1089f1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:33.826177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-544009a2-08b6-4604-a84b-9b0a8f1089f1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:12:33.826177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:33.826177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:33.826177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:33.826177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:33.826177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:33.826177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:33.826177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:33.826177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:12:33.826177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:33.826177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:33.826177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:33.826177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:33.826177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:33.826177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:33.826177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:33.828128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:33.828128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:33.828128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:33.828128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:33.828128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:33.828128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:33.828128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:33.828128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:33.828128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:33.828128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:33.828128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:33.828128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:33.828128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:33.828128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:33.828128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:33.828128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:33.828128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:33.830115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:33.830115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:33.830115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:33.830115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:33.830115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:33.830115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:33.830115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:33.830115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:33.830115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:33.830115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:33.830115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:33.830115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:33.830115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:12:33.830115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:33.831641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5e5d4-4de0-4e48-bb56-33cceb8f671c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:33.831641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5e5d4-4de0-4e48-bb56-33cceb8f671c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:33.831641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5e5d4-4de0-4e48-bb56-33cceb8f671c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:33.831641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5e5d4-4de0-4e48-bb56-33cceb8f671c None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:33.837057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5e5d4-4de0-4e48-bb56-33cceb8f671c None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:33.837057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5e5d4-4de0-4e48-bb56-33cceb8f671c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:33.837190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 469/934] 10.222.0.107 () {56 vars in 1137 bytes} [Tue Aug 23 23:12:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:33.837190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544009a2-08b6-4604-a84b-9b0a8f1089f1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:33.837337 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5e5d4-4de0-4e48-bb56-33cceb8f671c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:33.856628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 466/935] 10.222.0.107 () {56 vars in 1117 bytes} [Tue Aug 23 23:12:33 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:33.918332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5e5d4-4de0-4e48-bb56-33cceb8f671c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:33.948004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:33.966390 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:33.975369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544009a2-08b6-4604-a84b-9b0a8f1089f1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:34.029755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5c52f-3b2c-457f-8db0-31a866e03835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:34.029945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5c52f-3b2c-457f-8db0-31a866e03835 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.030155 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5c52f-3b2c-457f-8db0-31a866e03835 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.030519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5c52f-3b2c-457f-8db0-31a866e03835 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.031168 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5c52f-3b2c-457f-8db0-31a866e03835 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:34.031468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5c52f-3b2c-457f-8db0-31a866e03835 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:34.033429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5c52f-3b2c-457f-8db0-31a866e03835 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:34.041097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 470/936] 10.222.0.107 () {56 vars in 1131 bytes} [Tue Aug 23 23:12:33 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:34.049300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5c52f-3b2c-457f-8db0-31a866e03835 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:34.080427 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5e5d4-4de0-4e48-bb56-33cceb8f671c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:34.129502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c852d-4a67-4996-8db4-a7c89f138cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:34.130150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c852d-4a67-4996-8db4-a7c89f138cfa None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.130754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c852d-4a67-4996-8db4-a7c89f138cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.131038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c852d-4a67-4996-8db4-a7c89f138cfa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.148482 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c852d-4a67-4996-8db4-a7c89f138cfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:34.154693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-019c852d-4a67-4996-8db4-a7c89f138cfa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:12:34.154693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:34.154693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:34.154693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:34.154693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:34.154693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:34.154693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:34.154693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:34.154693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:34.154693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:34.154693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:34.154693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:34.154693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:34.154693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:34.154693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:34.154693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:34.156075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:34.156075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:34.156075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:34.156075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:34.156075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:34.156075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:34.156075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:34.156075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:34.156075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:34.156075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:34.156075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:34.156075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:34.156075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:34.156075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:34.156075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:34.156075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:34.156944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:34.156944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:34.156944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:34.156944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:34.156944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:34.156944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:34.156944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:34.156944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:34.156944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:34.156944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:34.156944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:12:34.156944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:34.156944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 467/937] 10.222.0.107 () {56 vars in 1125 bytes} [Tue Aug 23 23:12:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:34.162303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c852d-4a67-4996-8db4-a7c89f138cfa None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:34.189333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5c52f-3b2c-457f-8db0-31a866e03835 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:34.236103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537b4fd-56d3-42c4-87f3-039249e1f90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:34.236752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537b4fd-56d3-42c4-87f3-039249e1f90e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.237033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537b4fd-56d3-42c4-87f3-039249e1f90e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.237308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537b4fd-56d3-42c4-87f3-039249e1f90e None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.237946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537b4fd-56d3-42c4-87f3-039249e1f90e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:34.238810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537b4fd-56d3-42c4-87f3-039249e1f90e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:34.240532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537b4fd-56d3-42c4-87f3-039249e1f90e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:34.254463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 471/938] 10.222.0.107 () {56 vars in 1131 bytes} [Tue Aug 23 23:12:34 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:34.255841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537b4fd-56d3-42c4-87f3-039249e1f90e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:34.277943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:34.288252 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:34.304208 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c852d-4a67-4996-8db4-a7c89f138cfa None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:34.342444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27c90c-7c04-41c1-9e14-ede6e7b647c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:34.343078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27c90c-7c04-41c1-9e14-ede6e7b647c7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.343359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27c90c-7c04-41c1-9e14-ede6e7b647c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.343633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27c90c-7c04-41c1-9e14-ede6e7b647c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.344792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27c90c-7c04-41c1-9e14-ede6e7b647c7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:34.345102 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27c90c-7c04-41c1-9e14-ede6e7b647c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:34.346886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27c90c-7c04-41c1-9e14-ede6e7b647c7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:34.356616 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 468/939] 10.222.0.107 () {56 vars in 1120 bytes} [Tue Aug 23 23:12:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:34.357863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714b700-8ca7-4afd-960f-f473cd5b75f3 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.358152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714b700-8ca7-4afd-960f-f473cd5b75f3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.358428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714b700-8ca7-4afd-960f-f473cd5b75f3 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.360628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 469/940] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:34.363158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714b700-8ca7-4afd-960f-f473cd5b75f3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:34.377557 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537b4fd-56d3-42c4-87f3-039249e1f90e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:34.416818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29b2c3-3d0a-4b6a-90c0-5eeb09f7ee66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:34.417432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b2c3-3d0a-4b6a-90c0-5eeb09f7ee66 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.417712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b2c3-3d0a-4b6a-90c0-5eeb09f7ee66 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.417981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b2c3-3d0a-4b6a-90c0-5eeb09f7ee66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.418643 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29b2c3-3d0a-4b6a-90c0-5eeb09f7ee66 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:34.420265 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29b2c3-3d0a-4b6a-90c0-5eeb09f7ee66 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:34.441282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 472/941] 10.222.0.107 () {60 vars in 1149 bytes} [Tue Aug 23 23:12:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:34.442402 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bcddb-c1e2-4a52-9ade-2ca48967b89e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.442688 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bcddb-c1e2-4a52-9ade-2ca48967b89e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.442963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bcddb-c1e2-4a52-9ade-2ca48967b89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.463096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-573bcddb-c1e2-4a52-9ade-2ca48967b89e None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:34.464456 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-573bcddb-c1e2-4a52-9ade-2ca48967b89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:34.510234 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714b700-8ca7-4afd-960f-f473cd5b75f3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:34.555014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ae385-405b-42f1-884e-8bd6eb7df303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:34.555629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ae385-405b-42f1-884e-8bd6eb7df303 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.555918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ae385-405b-42f1-884e-8bd6eb7df303 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.556195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ae385-405b-42f1-884e-8bd6eb7df303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.572621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 473/942] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:34 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:34.572853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:34.574319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ae385-405b-42f1-884e-8bd6eb7df303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:34.575877 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ae385-405b-42f1-884e-8bd6eb7df303 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:34.593623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-098ae385-405b-42f1-884e-8bd6eb7df303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:34.593623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:34.593623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:34.593623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:34.593623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:34.593623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:34.593623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:34.593623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:34.593623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:34.593623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:34.593623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:34.593623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:34.593623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:34.593623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:34.593623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:34.593623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:34.594649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:34.594649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:34.594649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:34.594649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:34.594649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:34.594649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:34.594649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:34.594649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:34.594649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:34.594649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:34.594649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:34.594649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:34.594649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:34.594649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:34.594649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:34.594649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:34.594649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:34.595825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:34.595825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:34.595825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:34.595825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 470/943] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:34.601587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bcddb-c1e2-4a52-9ade-2ca48967b89e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:34.625791 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:34.714467 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bcddb-c1e2-4a52-9ade-2ca48967b89e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:34.751257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd016182-3637-4697-95a1-3536be6d2961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:34.751871 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd016182-3637-4697-95a1-3536be6d2961 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.752150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd016182-3637-4697-95a1-3536be6d2961 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.752418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd016182-3637-4697-95a1-3536be6d2961 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.753095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd016182-3637-4697-95a1-3536be6d2961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:34.753397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd016182-3637-4697-95a1-3536be6d2961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:34.754759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd016182-3637-4697-95a1-3536be6d2961 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:34.767024 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 474/944] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:34.773093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ae385-405b-42f1-884e-8bd6eb7df303 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:34.861826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd016182-3637-4697-95a1-3536be6d2961 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:34.895073 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ae385-405b-42f1-884e-8bd6eb7df303 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:34.935237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57faf97-776d-46b6-bbe7-1d96c71c5913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:34.936710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57faf97-776d-46b6-bbe7-1d96c71c5913 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:34.937155 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57faf97-776d-46b6-bbe7-1d96c71c5913 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:34.937574 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57faf97-776d-46b6-bbe7-1d96c71c5913 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:34.944051 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:34.947926 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57faf97-776d-46b6-bbe7-1d96c71c5913 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:34.949630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57faf97-776d-46b6-bbe7-1d96c71c5913 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:34.964626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c57faf97-776d-46b6-bbe7-1d96c71c5913 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:12:34.964626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:34.964626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:34.964626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:34.964626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:34.964626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:34.964626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:34.964626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:34.964626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:34.964626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:34.964626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:34.964626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:34.964626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:34.964626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:34.964626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:34.964626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:34.965832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:34.965832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:34.965832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:34.965832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:34.965832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:34.965832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:34.965832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:34.965832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:34.965832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:34.965832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:34.965832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:34.965832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:34.965832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:34.965832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:34.965832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:34.965832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:34.965832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:34.965832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:34.967041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:34.967041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:34.967041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:34.967041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:34.967041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:34.967041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:34.967041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:34.967041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:34.967041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:12:34.967041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:34.969983 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 471/945] 10.222.0.107 () {56 vars in 1122 bytes} [Tue Aug 23 23:12:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:34.977610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57faf97-776d-46b6-bbe7-1d96c71c5913 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:34.999522 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd016182-3637-4697-95a1-3536be6d2961 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:35.035503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:35.039419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9966c6-ec42-4d6c-8864-9708f67001c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:35.040570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9966c6-ec42-4d6c-8864-9708f67001c9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:35.041126 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9966c6-ec42-4d6c-8864-9708f67001c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:35.041642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9966c6-ec42-4d6c-8864-9708f67001c9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:35.043136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9966c6-ec42-4d6c-8864-9708f67001c9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:35.045090 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9966c6-ec42-4d6c-8864-9708f67001c9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:35.055185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-db9966c6-ec42-4d6c-8864-9708f67001c9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:12:35.055185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:35.055185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:35.055185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:35.055185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:35.055185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:35.055185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:35.055185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:35.055185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:12:35.055185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:35.055185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:35.055185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:35.055185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:35.055185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:35.055185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:35.055185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:35.055185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:35.056239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:35.056239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:35.056239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:35.056239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:35.056239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:35.056239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:35.056239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:35.056239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:35.056239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:35.056239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:35.056239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:35.056239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:35.056239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:35.056239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:35.056239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:35.056239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:35.057117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:35.057117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:35.057117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:35.057117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:35.057117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:35.057117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:35.057117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:35.057117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:35.057117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:35.057117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:35.057117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:35.057117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:35.057117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:12:35.057117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:35.059957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 475/946] 10.222.0.107 () {56 vars in 1131 bytes} [Tue Aug 23 23:12:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:35.068680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9966c6-ec42-4d6c-8864-9708f67001c9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:35.098527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57faf97-776d-46b6-bbe7-1d96c71c5913 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:35.136874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa2463-c33d-4b84-b5cb-b60be76215a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:35.137404 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa2463-c33d-4b84-b5cb-b60be76215a4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:35.137684 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa2463-c33d-4b84-b5cb-b60be76215a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:35.137961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa2463-c33d-4b84-b5cb-b60be76215a4 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:35.138715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa2463-c33d-4b84-b5cb-b60be76215a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:35.138996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa2463-c33d-4b84-b5cb-b60be76215a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:35.140482 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa2463-c33d-4b84-b5cb-b60be76215a4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:35.160876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 472/947] 10.222.0.107 () {56 vars in 1154 bytes} [Tue Aug 23 23:12:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:35.170763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa2463-c33d-4b84-b5cb-b60be76215a4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:35.191429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9966c6-ec42-4d6c-8864-9708f67001c9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:35.227375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a095d46-4186-415a-8925-d2af1c678bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:35.227987 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a095d46-4186-415a-8925-d2af1c678bfd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:35.228266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a095d46-4186-415a-8925-d2af1c678bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:35.228539 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a095d46-4186-415a-8925-d2af1c678bfd None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:35.229203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a095d46-4186-415a-8925-d2af1c678bfd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:35.229508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a095d46-4186-415a-8925-d2af1c678bfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:35.230995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a095d46-4186-415a-8925-d2af1c678bfd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:35.236381 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:35.236656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 476/948] 10.222.0.107 () {56 vars in 1127 bytes} [Tue Aug 23 23:12:35 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:35.243551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a095d46-4186-415a-8925-d2af1c678bfd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:35.303939 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa2463-c33d-4b84-b5cb-b60be76215a4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:35.314779 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:35.351548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c67f6-cee9-40a0-9244-2da808776f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:35.353019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c67f6-cee9-40a0-9244-2da808776f33 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:35.353824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c67f6-cee9-40a0-9244-2da808776f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:35.354344 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c67f6-cee9-40a0-9244-2da808776f33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:35.371711 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c67f6-cee9-40a0-9244-2da808776f33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:35.374630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c67f6-cee9-40a0-9244-2da808776f33 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:35.384949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a095d46-4186-415a-8925-d2af1c678bfd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:35.404813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9d9c67f6-cee9-40a0-9244-2da808776f33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:35.404813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:35.404813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:35.404813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:35.404813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:35.404813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:35.404813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:35.404813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:35.404813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:35.404813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:35.404813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:35.404813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:35.404813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:35.404813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:35.404813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:35.404813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:35.405898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:35.405898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:35.405898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:35.405898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:35.405898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:35.405898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:35.405898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:35.405898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:35.405898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:35.405898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:35.405898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:35.405898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:35.405898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:35.405898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:35.405898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:35.405898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:35.405898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:35.407603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:35.407603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:35.407603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:35.407603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 473/949] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:35.415219 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c67f6-cee9-40a0-9244-2da808776f33 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:35.453460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aecffc-d795-4cce-ae75-39f41deb730f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:35.454512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aecffc-d795-4cce-ae75-39f41deb730f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:35.454896 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aecffc-d795-4cce-ae75-39f41deb730f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:35.455168 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aecffc-d795-4cce-ae75-39f41deb730f None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:35.455806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aecffc-d795-4cce-ae75-39f41deb730f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:35.456230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aecffc-d795-4cce-ae75-39f41deb730f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:35.458148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aecffc-d795-4cce-ae75-39f41deb730f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:35.466132 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 477/950] 10.222.0.107 () {56 vars in 1127 bytes} [Tue Aug 23 23:12:35 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:35.471666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aecffc-d795-4cce-ae75-39f41deb730f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:35.544524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c67f6-cee9-40a0-9244-2da808776f33 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:35.546380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:35.596998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5446d0d-0c11-42b7-8963-07eae6f0c59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:35.597796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5446d0d-0c11-42b7-8963-07eae6f0c59c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:35.598528 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5446d0d-0c11-42b7-8963-07eae6f0c59c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:35.598897 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5446d0d-0c11-42b7-8963-07eae6f0c59c None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:35.600131 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5446d0d-0c11-42b7-8963-07eae6f0c59c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:35.601317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5446d0d-0c11-42b7-8963-07eae6f0c59c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:35.603698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5446d0d-0c11-42b7-8963-07eae6f0c59c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:35.606999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aecffc-d795-4cce-ae75-39f41deb730f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:35.622888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 474/951] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:35.633713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5446d0d-0c11-42b7-8963-07eae6f0c59c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:35.657587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:35.662557 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad430b2-31b0-478f-93e6-c8e04fa7a5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:35.663687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad430b2-31b0-478f-93e6-c8e04fa7a5e8 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:35.663958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad430b2-31b0-478f-93e6-c8e04fa7a5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:35.664221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad430b2-31b0-478f-93e6-c8e04fa7a5e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:35.664935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad430b2-31b0-478f-93e6-c8e04fa7a5e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:35.666412 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad430b2-31b0-478f-93e6-c8e04fa7a5e8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:35.694485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 478/952] 10.222.0.107 () {60 vars in 1149 bytes} [Tue Aug 23 23:12:35 2022] POST /identity/v3/endpoints => generated 351 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:35.777494 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5446d0d-0c11-42b7-8963-07eae6f0c59c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:35.834806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a262385-b98d-4376-a311-b61b361e38d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:35.835843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a262385-b98d-4376-a311-b61b361e38d0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:35.836580 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a262385-b98d-4376-a311-b61b361e38d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:35.837318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a262385-b98d-4376-a311-b61b361e38d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:35.845725 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a262385-b98d-4376-a311-b61b361e38d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:35.848708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a262385-b98d-4376-a311-b61b361e38d0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:35.866022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-0a262385-b98d-4376-a311-b61b361e38d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:35.866022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:35.866022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:35.866022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:35.866022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:35.866022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:35.866022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:35.866022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:35.866022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:35.866022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:35.866022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:35.866022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:35.866022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:35.866022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:35.866022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:35.868099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:35.868099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:35.868099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:35.868099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:35.868099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:35.868099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:35.868099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:35.868099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:35.868099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:35.868099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:35.868099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:35.868099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:35.868099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:35.868099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:35.868099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:35.868099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:35.868099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:35.869644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:35.869644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:35.869644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:35.869644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:35.869644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:35.869644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:35.869644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:35.869644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:35.872097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 475/953] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:35.879614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad430b2-31b0-478f-93e6-c8e04fa7a5e8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:36.009581 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad430b2-31b0-478f-93e6-c8e04fa7a5e8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:36.036137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:36.060655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695de47-1a50-4347-bb87-dae942350e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:36.060655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695de47-1a50-4347-bb87-dae942350e04 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:36.060655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695de47-1a50-4347-bb87-dae942350e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:36.060655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695de47-1a50-4347-bb87-dae942350e04 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:36.061081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695de47-1a50-4347-bb87-dae942350e04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:36.061081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695de47-1a50-4347-bb87-dae942350e04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:36.061081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695de47-1a50-4347-bb87-dae942350e04 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:36.076632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 479/954] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:36.080321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a262385-b98d-4376-a311-b61b361e38d0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:36.109771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a411fc-49c1-42f6-b82b-7dfccd175e1b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:36.109771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a411fc-49c1-42f6-b82b-7dfccd175e1b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:36.109771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a411fc-49c1-42f6-b82b-7dfccd175e1b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:36.110508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 480/955] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:12:36.111977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84a1d8-0802-4637-b092-854a586edb11 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:36.112271 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84a1d8-0802-4637-b092-854a586edb11 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:36.112532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84a1d8-0802-4637-b092-854a586edb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:36.140628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cc84a1d8-0802-4637-b092-854a586edb11 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:36.143050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cc84a1d8-0802-4637-b092-854a586edb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:36.267081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 481/956] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:36 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:36.268035 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:36.322507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a262385-b98d-4376-a311-b61b361e38d0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:36.381530 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320d786-d94a-4bfc-8538-cb056beee288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:36.384638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320d786-d94a-4bfc-8538-cb056beee288 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:36.384638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320d786-d94a-4bfc-8538-cb056beee288 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:36.384638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320d786-d94a-4bfc-8538-cb056beee288 None admin] PATH_INFO: `/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/238ad0efedfd4cd89d99e2abebaeba63/roles/66e20b7ea4884a8891f2561c6efe905f` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:36.385872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320d786-d94a-4bfc-8538-cb056beee288 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7cdd07c79614516be35aa2d82ec6a3b, user_id=238ad0efedfd4cd89d99e2abebaeba63, role_id=66e20b7ea4884a8891f2561c6efe905f)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:36.387562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320d786-d94a-4bfc-8538-cb056beee288 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:36.409348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 476/957] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:12:36 2022] PUT /identity/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/238ad0efedfd4cd89d99e2abebaeba63/roles/66e20b7ea4884a8891f2561c6efe905f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:12:36.609947 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84a1d8-0802-4637-b092-854a586edb11 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:36.734107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84a1d8-0802-4637-b092-854a586edb11 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:36.734437 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f2058-1bd1-4060-a5b7-95ad4f1d5bdc None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:36.734664 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f2058-1bd1-4060-a5b7-95ad4f1d5bdc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:36.734947 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f2058-1bd1-4060-a5b7-95ad4f1d5bdc None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:36.737714 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 477/958] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:36.742523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcfa40-c657-4452-a148-1b344cd6423d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:36.742968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcfa40-c657-4452-a148-1b344cd6423d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:36.743246 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcfa40-c657-4452-a148-1b344cd6423d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:36.750244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:36.764854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2dbcfa40-c657-4452-a148-1b344cd6423d None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:36.766351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2dbcfa40-c657-4452-a148-1b344cd6423d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:36.776831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280da73-7095-4452-97b3-70aeac7c7d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:36.777459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280da73-7095-4452-97b3-70aeac7c7d1e None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:36.777740 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280da73-7095-4452-97b3-70aeac7c7d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:36.778006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280da73-7095-4452-97b3-70aeac7c7d1e None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:36.779121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280da73-7095-4452-97b3-70aeac7c7d1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:36.781160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280da73-7095-4452-97b3-70aeac7c7d1e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:36.784741 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: WARNING keystone.server.flask.common [None req-0280da73-7095-4452-97b3-70aeac7c7d1e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 23:12:36.801618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.sql.core [None req-0280da73-7095-4452-97b3-70aeac7c7d1e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 23:12:36.801618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 23:12:36.801618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [parameters: {'user_id': 'c2deeede01524474832e3bf14209baad', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 23:12:36.801618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81438) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 23:12:36.823076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-0280da73-7095-4452-97b3-70aeac7c7d1e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 23:12:36.823076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:36.823076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:12:36.823076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:12:36.823076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:12:36.823076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:12:36.823076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:12:36.823076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:12:36.823076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:12:36.823076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:12:36.823076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:12:36.823076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:12:36.823076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:12:36.823076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application result.read() Aug 23 23:12:36.823076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:12:36.824396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:12:36.824396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:12:36.824396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:12:36.824396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:12:36.824396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:12:36.824396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:12:36.824396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:12:36.824396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 23:12:36.824396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:36.824396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 23:12:36.824396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:36.824396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:36.824396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 23:12:36.824396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 23:12:36.824396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 23 23:12:36.824396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 23 23:12:36.824396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:12:36.824396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:12:36.825872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 23:12:36.825872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application yield resource Aug 23 23:12:36.825872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:12:36.825872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:12:36.825872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 23:12:36.825872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 23:12:36.825872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 23:12:36.825872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 23:12:36.825872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 23:12:36.825872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise self.value Aug 23 23:12:36.825872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 23:12:36.825872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 23:12:36.825872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 23:12:36.825872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application session.commit() Aug 23 23:12:36.825872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 23:12:36.825872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 23:12:36.825872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 23:12:36.826951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 23:12:36.826951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 23:12:36.826951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.session.flush() Aug 23 23:12:36.826951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 23:12:36.826951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 23:12:36.826951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 23:12:36.826951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 23:12:36.826951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 23:12:36.826951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application compat.raise_( Aug 23 23:12:36.826951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:12:36.826951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception Aug 23 23:12:36.826951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 23:12:36.826951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 23:12:36.826951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 23:12:36.826951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 23:12:36.826951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 23:12:36.826951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 23:12:36.828029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 23:12:36.828029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 23:12:36.828029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 23:12:36.828029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 23 23:12:36.828029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 23:12:36.828029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 23:12:36.828029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 23:12:36.828029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 23:12:36.828029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 23:12:36.828029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 23:12:36.828029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 23:12:36.828029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 23:12:36.828029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 23:12:36.828029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 23:12:36.828029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:12:36.828029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception Aug 23 23:12:36.829089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:12:36.829089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:12:36.829089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:12:36.829089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:12:36.829089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:12:36.829089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:12:36.829089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:12:36.829089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:12:36.829089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:12:36.829089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:12:36.829089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:12:36.829089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application result.read() Aug 23 23:12:36.829089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:12:36.829089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:12:36.829089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:12:36.829089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:12:36.830417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:12:36.830417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:12:36.830417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:12:36.830417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:12:36.830417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 23:12:36.830417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 23:12:36.830417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c2deeede01524474832e3bf14209baad', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 23:12:36.830417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 23:12:36.830417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:36.830417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:36.830417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:36.830417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:36.830417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:36.830417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:36.830417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:36.831634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:36.831634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:36.831634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:36.831634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:36.831634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:36.831634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:36.831634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:36.831634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 23 23:12:36.831634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 23 23:12:36.831634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:36.831634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:36.831634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:36.831634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:36.831634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:36.831634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:36.831634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 23 23:12:36.831634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 23 23:12:36.833531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 23 23:12:36.833531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 23 23:12:36.833531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 23:12:36.833531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 23:12:36.833531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 23:12:36.833531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:36.833531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 482/959] 10.222.0.107 () {60 vars in 1136 bytes} [Tue Aug 23 23:12:36 2022] POST /identity/v3/users => generated 160 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:36.833531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280da73-7095-4452-97b3-70aeac7c7d1e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:36.849717 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 478/960] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:36 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:12:36.983976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280da73-7095-4452-97b3-70aeac7c7d1e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:37.021660 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b20dc-eb55-42c6-b097-e735f1794b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:37.022451 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b20dc-eb55-42c6-b097-e735f1794b3c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:37.022694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b20dc-eb55-42c6-b097-e735f1794b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:37.022890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b20dc-eb55-42c6-b097-e735f1794b3c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:37.031956 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b20dc-eb55-42c6-b097-e735f1794b3c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:37.033660 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b20dc-eb55-42c6-b097-e735f1794b3c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:37.046762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-623b20dc-eb55-42c6-b097-e735f1794b3c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:12:37.046762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:37.046762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:37.046762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:37.046762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:37.046762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:37.046762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:37.046762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:37.046762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:37.046762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:37.046762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:37.046762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:37.046762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:37.046762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:37.046762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:37.046762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:37.047733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:37.047733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:37.047733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:37.047733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:37.047733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:37.047733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:37.047733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:37.047733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:37.047733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:37.047733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:37.047733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:37.047733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:37.047733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:37.047733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:37.047733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:37.047733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:37.047733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:37.047733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:37.048730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:37.048730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:37.048730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:37.048730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:37.048730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:37.048730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:37.048730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:37.048730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:37.048730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:12:37.048730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:37.048730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 483/961] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:12:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:37.054342 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcfa40-c657-4452-a148-1b344cd6423d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:37.121808 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:37.167500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcfa40-c657-4452-a148-1b344cd6423d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:37.188399 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b20dc-eb55-42c6-b097-e735f1794b3c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:37.209149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0cb2d-1729-40fe-bde0-531ffaf04ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:37.210874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0cb2d-1729-40fe-bde0-531ffaf04ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:37.211315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0cb2d-1729-40fe-bde0-531ffaf04ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:37.211741 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0cb2d-1729-40fe-bde0-531ffaf04ee9 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:37.212922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0cb2d-1729-40fe-bde0-531ffaf04ee9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:37.213736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0cb2d-1729-40fe-bde0-531ffaf04ee9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:37.215345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0cb2d-1729-40fe-bde0-531ffaf04ee9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:37.226268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:37.265233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 479/962] 10.222.0.107 () {56 vars in 1106 bytes} [Tue Aug 23 23:12:37 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:37.309709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b20dc-eb55-42c6-b097-e735f1794b3c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:37.350082 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847459a-6677-44b1-8738-59034446f8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:37.351244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847459a-6677-44b1-8738-59034446f8dc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:37.351682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847459a-6677-44b1-8738-59034446f8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:37.352104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847459a-6677-44b1-8738-59034446f8dc None admin] PATH_INFO: `/v3/services/compute` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:37.352902 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847459a-6677-44b1-8738-59034446f8dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:37.354481 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847459a-6677-44b1-8738-59034446f8dc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:37.364421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-5847459a-6677-44b1-8738-59034446f8dc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:12:37.364421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:37.364421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:37.364421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:37.364421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:37.364421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:37.364421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:37.364421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:37.364421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:12:37.364421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:37.364421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:37.364421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:37.364421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:37.364421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:37.364421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:37.364421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:37.364421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:37.365780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:37.365780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:37.365780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:37.365780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:37.365780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:37.365780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:37.365780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:37.365780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:37.365780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:37.365780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:37.365780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:37.365780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:37.365780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:37.365780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:37.365780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:37.365780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:37.366919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:37.366919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:37.366919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:37.366919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:37.366919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:37.366919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:37.366919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:37.366919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:37.366919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:37.366919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:37.366919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:37.366919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:37.366919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:12:37.366919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:37.369561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 484/963] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:37.379295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0cb2d-1729-40fe-bde0-531ffaf04ee9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:37.493699 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0cb2d-1729-40fe-bde0-531ffaf04ee9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:37.518561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:37.532873 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403696a2-54c1-4ded-83ae-270a58ad5de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:37.533778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403696a2-54c1-4ded-83ae-270a58ad5de3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:37.534268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403696a2-54c1-4ded-83ae-270a58ad5de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:37.534723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403696a2-54c1-4ded-83ae-270a58ad5de3 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:37.535541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403696a2-54c1-4ded-83ae-270a58ad5de3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:37.536026 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403696a2-54c1-4ded-83ae-270a58ad5de3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:37.537611 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403696a2-54c1-4ded-83ae-270a58ad5de3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:37.544060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 480/964] 10.222.0.107 () {56 vars in 1117 bytes} [Tue Aug 23 23:12:37 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:37.549923 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847459a-6677-44b1-8738-59034446f8dc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:37.649618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:37.657706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847459a-6677-44b1-8738-59034446f8dc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:37.692522 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874b187-cb35-4137-beb5-25eaea7c7710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:37.693208 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874b187-cb35-4137-beb5-25eaea7c7710 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:37.693489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874b187-cb35-4137-beb5-25eaea7c7710 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:37.693758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874b187-cb35-4137-beb5-25eaea7c7710 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:37.694632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874b187-cb35-4137-beb5-25eaea7c7710 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:37.695167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874b187-cb35-4137-beb5-25eaea7c7710 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:37.696621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874b187-cb35-4137-beb5-25eaea7c7710 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:37.712687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 485/965] 10.222.0.107 () {56 vars in 1117 bytes} [Tue Aug 23 23:12:37 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:37.880551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb55cc-353b-4534-8c07-62c0add57b23 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:37.880867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb55cc-353b-4534-8c07-62c0add57b23 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:37.881061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb55cc-353b-4534-8c07-62c0add57b23 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:37.882620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 481/966] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:37.887827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03124f-a5b7-41f5-89be-ee588368c431 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:37.888113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03124f-a5b7-41f5-89be-ee588368c431 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:37.888388 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03124f-a5b7-41f5-89be-ee588368c431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:37.906895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1a03124f-a5b7-41f5-89be-ee588368c431 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:37.908440 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1a03124f-a5b7-41f5-89be-ee588368c431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:37.989830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 486/967] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:37 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:38.265642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb55cc-353b-4534-8c07-62c0add57b23 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:38.371760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb55cc-353b-4534-8c07-62c0add57b23 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:38.407006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65e23e-38f8-4993-8e9b-86a7164d0d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:38.407628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65e23e-38f8-4993-8e9b-86a7164d0d4d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:38.407978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65e23e-38f8-4993-8e9b-86a7164d0d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:38.408172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65e23e-38f8-4993-8e9b-86a7164d0d4d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:38.408775 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65e23e-38f8-4993-8e9b-86a7164d0d4d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:38.410141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65e23e-38f8-4993-8e9b-86a7164d0d4d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:38.420044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-1e65e23e-38f8-4993-8e9b-86a7164d0d4d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:12:38.420044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:38.420044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:38.420044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:38.420044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:38.420044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:38.420044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:38.420044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:38.420044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:12:38.420044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:38.420044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:38.420044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:38.420044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:38.420044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:38.420044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:38.420044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:38.420044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:38.421403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:38.421403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:38.421403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:38.421403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:38.421403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:38.421403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:38.421403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:38.421403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:38.421403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:38.421403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:38.421403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:38.421403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:38.421403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:38.421403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:38.421403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:38.421403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:38.422801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:38.422801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:38.422801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:38.422801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:38.422801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:38.422801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:38.422801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:38.422801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:38.422801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:38.422801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:38.422801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:38.422801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:38.422801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:12:38.422801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:38.423967 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 482/968] 10.222.0.107 () {56 vars in 1131 bytes} [Tue Aug 23 23:12:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:38.427077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03124f-a5b7-41f5-89be-ee588368c431 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:38.519685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:38.534142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03124f-a5b7-41f5-89be-ee588368c431 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:38.562816 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6c0de-9b7a-40fb-973f-cfc6c5504077 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:38.563099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6c0de-9b7a-40fb-973f-cfc6c5504077 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:38.563373 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6c0de-9b7a-40fb-973f-cfc6c5504077 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:38.564863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 483/969] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:12:38.570554 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407a294-4139-4534-87c3-4ff555d741f2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:38.570832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407a294-4139-4534-87c3-4ff555d741f2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:38.571104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407a294-4139-4534-87c3-4ff555d741f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:38.571757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df7564-ddc5-4023-920a-a9a2c9ea8b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:38.572382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df7564-ddc5-4023-920a-a9a2c9ea8b63 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:38.572842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df7564-ddc5-4023-920a-a9a2c9ea8b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:38.573113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df7564-ddc5-4023-920a-a9a2c9ea8b63 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:38.573824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df7564-ddc5-4023-920a-a9a2c9ea8b63 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:38.574054 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df7564-ddc5-4023-920a-a9a2c9ea8b63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:38.575409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df7564-ddc5-4023-920a-a9a2c9ea8b63 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:38.587242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 487/970] 10.222.0.107 () {56 vars in 1127 bytes} [Tue Aug 23 23:12:38 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:38.588222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df7564-ddc5-4023-920a-a9a2c9ea8b63 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:38.589596 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d407a294-4139-4534-87c3-4ff555d741f2 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:38.590786 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d407a294-4139-4534-87c3-4ff555d741f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:38.649837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:38.677388 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 484/971] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:38 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:12:38.698556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df7564-ddc5-4023-920a-a9a2c9ea8b63 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:38.736923 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19083e80-718e-48d8-af42-55032dd2e0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:38.737531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19083e80-718e-48d8-af42-55032dd2e0a6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:38.737807 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19083e80-718e-48d8-af42-55032dd2e0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:38.738073 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19083e80-718e-48d8-af42-55032dd2e0a6 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:38.738710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19083e80-718e-48d8-af42-55032dd2e0a6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:38.739002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19083e80-718e-48d8-af42-55032dd2e0a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:38.740353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19083e80-718e-48d8-af42-55032dd2e0a6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:38.751288 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 488/972] 10.222.0.107 () {56 vars in 1127 bytes} [Tue Aug 23 23:12:38 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:38.752177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407a294-4139-4534-87c3-4ff555d741f2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:38.859911 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407a294-4139-4534-87c3-4ff555d741f2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:38.896662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b6f31-637a-4752-87ac-a887cf397147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:38.897831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b6f31-637a-4752-87ac-a887cf397147 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:38.898151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b6f31-637a-4752-87ac-a887cf397147 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:38.898419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b6f31-637a-4752-87ac-a887cf397147 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:38.899233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b6f31-637a-4752-87ac-a887cf397147 None admin] RBAC: Adding query filter params (interface=admin, service_id=b3c91ec56dae4199a9d5a359e9ad7419, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:38.899545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b6f31-637a-4752-87ac-a887cf397147 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:38.901013 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b6f31-637a-4752-87ac-a887cf397147 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:38.911962 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 485/973] 10.222.0.107 () {56 vars in 1254 bytes} [Tue Aug 23 23:12:38 2022] GET /identity/v3/endpoints?service_id=b3c91ec56dae4199a9d5a359e9ad7419&interface=admin®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:38.914901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19083e80-718e-48d8-af42-55032dd2e0a6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:38.936416 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:38.952543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b6f31-637a-4752-87ac-a887cf397147 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:39.002726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:39.038754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19083e80-718e-48d8-af42-55032dd2e0a6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:39.071631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b6f31-637a-4752-87ac-a887cf397147 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:39.079633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf4b6e-e27c-452b-b361-0f0879d11619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:39.080508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf4b6e-e27c-452b-b361-0f0879d11619 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:39.080805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf4b6e-e27c-452b-b361-0f0879d11619 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:39.081074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf4b6e-e27c-452b-b361-0f0879d11619 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:39.081678 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf4b6e-e27c-452b-b361-0f0879d11619 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:39.083045 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf4b6e-e27c-452b-b361-0f0879d11619 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:39.092093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 489/974] 10.222.0.107 () {56 vars in 1092 bytes} [Tue Aug 23 23:12:38 2022] GET /identity/v3/services => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:12:39.127857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4eff2b-891a-418f-b45f-d73855e8859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:39.128425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4eff2b-891a-418f-b45f-d73855e8859b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:39.128734 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4eff2b-891a-418f-b45f-d73855e8859b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:39.129006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4eff2b-891a-418f-b45f-d73855e8859b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:39.141183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4eff2b-891a-418f-b45f-d73855e8859b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:39.146094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4e4eff2b-891a-418f-b45f-d73855e8859b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:12:39.146094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:39.146094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:39.146094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:39.146094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:39.146094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:39.146094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:39.146094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:39.146094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:39.146094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:39.146094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:39.146094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:39.146094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:39.146094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:39.146094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:39.146094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:39.147136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:39.147136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:39.147136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:39.147136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:39.147136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:39.147136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:39.147136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:39.147136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:39.147136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:39.147136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:39.147136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:39.147136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:39.147136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:39.147136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:39.147136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:39.147136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:39.148627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:39.148627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:39.148627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:39.148627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:39.148627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:39.148627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:39.148627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:39.148627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:39.148627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:39.148627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:39.148627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:12:39.148627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:39.148627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 486/975] 10.222.0.107 () {56 vars in 1125 bytes} [Tue Aug 23 23:12:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:39.153924 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf4b6e-e27c-452b-b361-0f0879d11619 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:39.245222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:39.267448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf4b6e-e27c-452b-b361-0f0879d11619 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:39.305232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bc99e-9acd-49f1-abdb-aff85c0a1c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:39.306131 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bc99e-9acd-49f1-abdb-aff85c0a1c1e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:39.306562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bc99e-9acd-49f1-abdb-aff85c0a1c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:39.306980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bc99e-9acd-49f1-abdb-aff85c0a1c1e None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:39.307799 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bc99e-9acd-49f1-abdb-aff85c0a1c1e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:39.308305 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bc99e-9acd-49f1-abdb-aff85c0a1c1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:39.310134 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bc99e-9acd-49f1-abdb-aff85c0a1c1e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:39.320152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 490/976] 10.222.0.107 () {56 vars in 1120 bytes} [Tue Aug 23 23:12:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:39.327903 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4eff2b-891a-418f-b45f-d73855e8859b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:39.435406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4eff2b-891a-418f-b45f-d73855e8859b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:39.437709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:39.471576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f41c06-ef37-4b1e-9305-f476a77e671f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:39.472209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f41c06-ef37-4b1e-9305-f476a77e671f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:39.472490 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f41c06-ef37-4b1e-9305-f476a77e671f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:39.472808 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f41c06-ef37-4b1e-9305-f476a77e671f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:39.483758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f41c06-ef37-4b1e-9305-f476a77e671f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:39.485241 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f41c06-ef37-4b1e-9305-f476a77e671f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:39.500531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-41f41c06-ef37-4b1e-9305-f476a77e671f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:39.500531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:39.500531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:39.500531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:39.500531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:39.500531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:39.500531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:39.500531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:39.500531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:39.500531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:39.500531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:39.500531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:39.500531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:39.500531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:39.500531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:39.500531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:39.501652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:39.501652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:39.501652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:39.501652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:39.501652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:39.501652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:39.501652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:39.501652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:39.501652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:39.501652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:39.501652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:39.501652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:39.501652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:39.501652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:39.501652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:39.501652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:39.501652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:39.502686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:39.502686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:39.502686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:39.502686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 487/977] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:39.509513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bc99e-9acd-49f1-abdb-aff85c0a1c1e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:39.618091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bc99e-9acd-49f1-abdb-aff85c0a1c1e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:39.653989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3118272-a9f6-4154-94bd-03914fea69b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:39.654674 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3118272-a9f6-4154-94bd-03914fea69b9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:39.654948 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3118272-a9f6-4154-94bd-03914fea69b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:39.655218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3118272-a9f6-4154-94bd-03914fea69b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:39.655923 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3118272-a9f6-4154-94bd-03914fea69b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:39.656226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3118272-a9f6-4154-94bd-03914fea69b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:39.657666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3118272-a9f6-4154-94bd-03914fea69b9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:39.675725 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 491/978] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:39.677048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f41c06-ef37-4b1e-9305-f476a77e671f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:39.681676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72c2c-8ba4-467e-8d2d-a811da100ebf None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:39.681969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72c2c-8ba4-467e-8d2d-a811da100ebf None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:39.682244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72c2c-8ba4-467e-8d2d-a811da100ebf None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:39.687473 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 492/979] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:12:39.689114 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d4fd9-a411-42ef-81c5-e51bf251d54b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:39.689498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d4fd9-a411-42ef-81c5-e51bf251d54b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:39.689859 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d4fd9-a411-42ef-81c5-e51bf251d54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:39.696536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:39.711890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a45d4fd9-a411-42ef-81c5-e51bf251d54b None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:39.713134 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a45d4fd9-a411-42ef-81c5-e51bf251d54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:39.783582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f41c06-ef37-4b1e-9305-f476a77e671f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:39.789381 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 493/980] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:39 2022] POST /identity/v3/auth/tokens => generated 1476 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:39.820979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01841911-9dbf-41e2-9884-77af79dc084e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:39.821613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01841911-9dbf-41e2-9884-77af79dc084e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:39.821892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01841911-9dbf-41e2-9884-77af79dc084e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:39.822165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01841911-9dbf-41e2-9884-77af79dc084e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:39.831392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01841911-9dbf-41e2-9884-77af79dc084e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:39.832866 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01841911-9dbf-41e2-9884-77af79dc084e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:39.844946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-01841911-9dbf-41e2-9884-77af79dc084e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:12:39.844946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:39.844946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:39.844946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:39.844946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:39.844946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:39.844946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:39.844946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:39.844946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:39.844946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:39.844946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:39.844946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:39.844946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:39.844946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:39.844946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:39.844946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:39.845930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:39.845930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:39.845930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:39.845930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:39.845930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:39.845930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:39.845930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:39.845930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:39.845930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:39.845930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:39.845930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:39.845930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:39.845930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:39.845930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:39.845930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:39.845930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:39.845930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:39.845930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:39.846870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:39.846870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:39.846870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:39.846870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:39.846870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:39.846870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:39.846870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:39.846870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:39.846870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:12:39.846870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:39.846870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 488/981] 10.222.0.107 () {56 vars in 1122 bytes} [Tue Aug 23 23:12:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:39.852333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d4fd9-a411-42ef-81c5-e51bf251d54b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:39.957660 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d4fd9-a411-42ef-81c5-e51bf251d54b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:39.998853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:40.004655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b52ee0-2507-4516-bcb5-a78d5ad2a31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:40.005268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b52ee0-2507-4516-bcb5-a78d5ad2a31b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:40.005542 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b52ee0-2507-4516-bcb5-a78d5ad2a31b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:40.005810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b52ee0-2507-4516-bcb5-a78d5ad2a31b None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:40.006548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b52ee0-2507-4516-bcb5-a78d5ad2a31b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:40.006853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b52ee0-2507-4516-bcb5-a78d5ad2a31b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:40.008282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b52ee0-2507-4516-bcb5-a78d5ad2a31b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:40.027131 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 494/982] 10.222.0.107 () {56 vars in 1154 bytes} [Tue Aug 23 23:12:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:40.032582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01841911-9dbf-41e2-9884-77af79dc084e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:40.052335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:40.065960 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b52ee0-2507-4516-bcb5-a78d5ad2a31b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:40.148982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01841911-9dbf-41e2-9884-77af79dc084e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:40.180129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b52ee0-2507-4516-bcb5-a78d5ad2a31b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:40.187514 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63707c76-a0f9-4eec-b514-a162bbf04cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:40.188540 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63707c76-a0f9-4eec-b514-a162bbf04cad None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:40.188938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63707c76-a0f9-4eec-b514-a162bbf04cad None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:40.189215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63707c76-a0f9-4eec-b514-a162bbf04cad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:40.224101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cf55e-dc59-4014-a960-1fb32650aed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:40.225027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cf55e-dc59-4014-a960-1fb32650aed0 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:40.225527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cf55e-dc59-4014-a960-1fb32650aed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:40.225895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cf55e-dc59-4014-a960-1fb32650aed0 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:40.226546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cf55e-dc59-4014-a960-1fb32650aed0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:40.227912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cf55e-dc59-4014-a960-1fb32650aed0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:40.245576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 495/983] 10.222.0.107 () {60 vars in 1146 bytes} [Tue Aug 23 23:12:40 2022] POST /identity/v3/services => generated 243 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:12:40.276365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63707c76-a0f9-4eec-b514-a162bbf04cad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:40.277792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63707c76-a0f9-4eec-b514-a162bbf04cad None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:40.297774 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:40.400470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 489/984] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:12:40 2022] GET /identity/v3/auth/tokens => generated 1476 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:12:40.406504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cf55e-dc59-4014-a960-1fb32650aed0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:40.465748 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:40.530101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cf55e-dc59-4014-a960-1fb32650aed0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:40.564845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4a7b3-8330-4044-a278-091484cfd419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:40.565483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4a7b3-8330-4044-a278-091484cfd419 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:40.565758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4a7b3-8330-4044-a278-091484cfd419 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:40.566024 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4a7b3-8330-4044-a278-091484cfd419 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:40.577647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4a7b3-8330-4044-a278-091484cfd419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:40.579104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4a7b3-8330-4044-a278-091484cfd419 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:40.594689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-08b4a7b3-8330-4044-a278-091484cfd419 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:40.594689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:40.594689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:40.594689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:40.594689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:40.594689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:40.594689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:40.594689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:40.594689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:40.594689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:40.594689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:40.594689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:40.594689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:40.594689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:40.594689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:40.594689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:40.595713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:40.595713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:40.595713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:40.595713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:40.595713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:40.595713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:40.595713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:40.595713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:40.595713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:40.595713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:40.595713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:40.595713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:40.595713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:40.595713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:40.595713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:40.595713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:40.595713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:40.597265 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:40.597265 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:40.597265 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:40.597603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 496/985] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:40.602732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63707c76-a0f9-4eec-b514-a162bbf04cad None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:40.706071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63707c76-a0f9-4eec-b514-a162bbf04cad None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:40.724452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:40.744373 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ebeef-1b4b-4aa7-9853-4e44ec21fe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:40.745005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ebeef-1b4b-4aa7-9853-4e44ec21fe73 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:40.745284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ebeef-1b4b-4aa7-9853-4e44ec21fe73 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:40.745556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ebeef-1b4b-4aa7-9853-4e44ec21fe73 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:40.746191 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ebeef-1b4b-4aa7-9853-4e44ec21fe73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:40.746493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ebeef-1b4b-4aa7-9853-4e44ec21fe73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:40.747850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ebeef-1b4b-4aa7-9853-4e44ec21fe73 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:40.759742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 490/986] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:40.765088 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4a7b3-8330-4044-a278-091484cfd419 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:40.867029 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:40.872656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4a7b3-8330-4044-a278-091484cfd419 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:40.908586 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd4fa7-81bf-4e6c-b6e7-b01da13c5279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:40.909544 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd4fa7-81bf-4e6c-b6e7-b01da13c5279 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:40.910001 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd4fa7-81bf-4e6c-b6e7-b01da13c5279 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:40.910481 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd4fa7-81bf-4e6c-b6e7-b01da13c5279 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:40.918283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd4fa7-81bf-4e6c-b6e7-b01da13c5279 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:40.920211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd4fa7-81bf-4e6c-b6e7-b01da13c5279 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:40.932488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-c7dd4fa7-81bf-4e6c-b6e7-b01da13c5279 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:40.932488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:40.932488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:40.932488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:40.932488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:40.932488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:40.932488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:40.932488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:40.932488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:40.932488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:40.932488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:40.932488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:40.932488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:40.932488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:40.932488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:40.933452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:40.933452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:40.933452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:40.933452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:40.933452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:40.933452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:40.933452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:40.933452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:40.933452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:40.933452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:40.933452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:40.933452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:40.933452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:40.933452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:40.933452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:40.933452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:40.933452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:40.934448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:40.934448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:40.934448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:40.934448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:40.934448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:40.934448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:40.934448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:40.934448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:40.939842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 497/987] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:40.940861 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ebeef-1b4b-4aa7-9853-4e44ec21fe73 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:41.043548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2654ff-a365-4e85-bc67-beabff92bfb5 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:41.044026 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2654ff-a365-4e85-bc67-beabff92bfb5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:41.044135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2654ff-a365-4e85-bc67-beabff92bfb5 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:41.045839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 498/988] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:12:41.050648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066366b8-e24f-49bf-9ae5-1155fdfe0468 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:41.050931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066366b8-e24f-49bf-9ae5-1155fdfe0468 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:41.051202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066366b8-e24f-49bf-9ae5-1155fdfe0468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:41.074102 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ebeef-1b4b-4aa7-9853-4e44ec21fe73 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:41.074516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-066366b8-e24f-49bf-9ae5-1155fdfe0468 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:41.077160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-066366b8-e24f-49bf-9ae5-1155fdfe0468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:41.120113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b52aa2-a32d-45f5-ac8d-9460cd611e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:41.120697 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b52aa2-a32d-45f5-ac8d-9460cd611e94 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:41.120985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b52aa2-a32d-45f5-ac8d-9460cd611e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:41.121271 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b52aa2-a32d-45f5-ac8d-9460cd611e94 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:41.121977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b52aa2-a32d-45f5-ac8d-9460cd611e94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:41.122296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b52aa2-a32d-45f5-ac8d-9460cd611e94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:41.123740 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b52aa2-a32d-45f5-ac8d-9460cd611e94 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:41.136653 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 491/989] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:41.142581 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b52aa2-a32d-45f5-ac8d-9460cd611e94 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:41.168363 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 499/990] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:41 2022] POST /identity/v3/auth/tokens => generated 1572 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:12:41.181759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:41.251172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b52aa2-a32d-45f5-ac8d-9460cd611e94 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:41.296102 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356dea1-aaae-47fb-81b3-31a0fd96cca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:41.296750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356dea1-aaae-47fb-81b3-31a0fd96cca6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:41.297037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356dea1-aaae-47fb-81b3-31a0fd96cca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:41.297296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356dea1-aaae-47fb-81b3-31a0fd96cca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:41.298023 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356dea1-aaae-47fb-81b3-31a0fd96cca6 None admin] RBAC: Adding query filter params (role.id=66e20b7ea4884a8891f2561c6efe905f, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=238ad0efedfd4cd89d99e2abebaeba63) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:41.298330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356dea1-aaae-47fb-81b3-31a0fd96cca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:41.299996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356dea1-aaae-47fb-81b3-31a0fd96cca6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:41.312855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 492/991] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:12:41 2022] GET /identity/v3/role_assignments?user.id=238ad0efedfd4cd89d99e2abebaeba63&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=66e20b7ea4884a8891f2561c6efe905f => generated 610 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:41.454153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066366b8-e24f-49bf-9ae5-1155fdfe0468 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:41.551161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:41.563569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066366b8-e24f-49bf-9ae5-1155fdfe0468 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:41.598514 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24206a-b450-4903-9e4b-cbd4695db8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:41.599147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24206a-b450-4903-9e4b-cbd4695db8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:41.599424 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24206a-b450-4903-9e4b-cbd4695db8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:41.599694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24206a-b450-4903-9e4b-cbd4695db8b3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:41.600288 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24206a-b450-4903-9e4b-cbd4695db8b3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:41.601722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24206a-b450-4903-9e4b-cbd4695db8b3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:41.610575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ef24206a-b450-4903-9e4b-cbd4695db8b3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:12:41.610575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:41.610575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:41.610575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:41.610575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:41.610575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:41.610575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:41.610575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:41.610575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:12:41.610575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:41.610575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:41.610575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:41.610575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:41.610575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:41.610575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:41.610575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:41.610575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:41.611626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:41.611626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:41.611626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:41.611626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:41.611626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:41.611626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:41.611626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:41.611626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:41.611626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:41.611626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:41.611626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:41.611626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:41.611626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:41.611626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:41.611626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:41.611626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:41.612532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:41.612532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:41.612532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:41.612532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:41.612532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:41.612532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:41.612532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:41.612532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:41.612532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:41.612532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:41.612532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:41.612532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:41.612532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:12:41.612532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:41.612532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 500/992] 10.222.0.107 () {56 vars in 1131 bytes} [Tue Aug 23 23:12:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:41.618554 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356dea1-aaae-47fb-81b3-31a0fd96cca6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:41.722422 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:41.726840 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356dea1-aaae-47fb-81b3-31a0fd96cca6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:41.763274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ff11f-0d5a-4fbc-9a3f-c8682a4d2c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:41.763879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ff11f-0d5a-4fbc-9a3f-c8682a4d2c42 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:41.764157 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ff11f-0d5a-4fbc-9a3f-c8682a4d2c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:41.764428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ff11f-0d5a-4fbc-9a3f-c8682a4d2c42 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:41.765087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ff11f-0d5a-4fbc-9a3f-c8682a4d2c42 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:41.765390 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ff11f-0d5a-4fbc-9a3f-c8682a4d2c42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:41.766757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ff11f-0d5a-4fbc-9a3f-c8682a4d2c42 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:41.777305 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 493/993] 10.222.0.107 () {56 vars in 1127 bytes} [Tue Aug 23 23:12:41 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:41.778689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24206a-b450-4903-9e4b-cbd4695db8b3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:41.881746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24206a-b450-4903-9e4b-cbd4695db8b3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:41.916433 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9185326-5097-4dcc-9892-5972c86eed8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:41.917074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9185326-5097-4dcc-9892-5972c86eed8b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:41.917353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9185326-5097-4dcc-9892-5972c86eed8b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:41.917624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9185326-5097-4dcc-9892-5972c86eed8b None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:41.918258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9185326-5097-4dcc-9892-5972c86eed8b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:41.918561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9185326-5097-4dcc-9892-5972c86eed8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:41.920180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9185326-5097-4dcc-9892-5972c86eed8b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:41.925569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 501/994] 10.222.0.107 () {56 vars in 1127 bytes} [Tue Aug 23 23:12:41 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:41.931404 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ff11f-0d5a-4fbc-9a3f-c8682a4d2c42 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:42.049235 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ff11f-0d5a-4fbc-9a3f-c8682a4d2c42 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:42.083034 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80291b-6cea-4ae7-a1e3-70de51f0252b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:42.083633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80291b-6cea-4ae7-a1e3-70de51f0252b None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:42.083908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80291b-6cea-4ae7-a1e3-70de51f0252b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:42.084180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80291b-6cea-4ae7-a1e3-70de51f0252b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:42.085707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80291b-6cea-4ae7-a1e3-70de51f0252b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:42.087077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80291b-6cea-4ae7-a1e3-70de51f0252b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:42.104168 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 494/995] 10.222.0.107 () {60 vars in 1149 bytes} [Tue Aug 23 23:12:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:12:42.235682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23c070-4bb7-4819-9951-96ae51b317f3 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:42.236076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23c070-4bb7-4819-9951-96ae51b317f3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:42.236251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23c070-4bb7-4819-9951-96ae51b317f3 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:42.237855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 502/996] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:42.244184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4224bb1-c313-4241-9999-4a67d4b7a007 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:42.244514 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4224bb1-c313-4241-9999-4a67d4b7a007 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:42.244777 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4224bb1-c313-4241-9999-4a67d4b7a007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:42.266640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c4224bb1-c313-4241-9999-4a67d4b7a007 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:42.267772 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c4224bb1-c313-4241-9999-4a67d4b7a007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:42.287221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:42.357286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 495/997] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:42 2022] POST /identity/v3/auth/tokens => generated 1720 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:12:42.623228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23c070-4bb7-4819-9951-96ae51b317f3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:42.642434 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:42.731351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23c070-4bb7-4819-9951-96ae51b317f3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:42.764998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88517a1-f90f-4184-989b-10f46f57b8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:42.765618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88517a1-f90f-4184-989b-10f46f57b8ce None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:42.765891 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88517a1-f90f-4184-989b-10f46f57b8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:42.766156 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88517a1-f90f-4184-989b-10f46f57b8ce None admin] PATH_INFO: `/v3/services/compute` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:42.766738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88517a1-f90f-4184-989b-10f46f57b8ce None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:42.768080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88517a1-f90f-4184-989b-10f46f57b8ce None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:42.777568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-b88517a1-f90f-4184-989b-10f46f57b8ce None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:12:42.777568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:42.777568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:42.777568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:42.777568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:42.777568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:42.777568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:42.777568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:42.777568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:12:42.777568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:42.777568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:42.777568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:42.777568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:42.777568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:42.777568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:42.777568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:42.777568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:42.778792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:42.778792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:42.778792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:42.778792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:42.778792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:42.778792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:42.778792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:42.778792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:42.778792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:42.778792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:42.778792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:42.778792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:42.778792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:42.778792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:42.778792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:42.778792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:42.779675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:42.779675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:42.779675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:42.779675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:42.779675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:42.779675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:42.779675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:42.779675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:42.779675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:42.779675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:42.779675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:42.779675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:42.779675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:12:42.779675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:42.783508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 503/998] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:42.784953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4224bb1-c313-4241-9999-4a67d4b7a007 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:42.891862 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4224bb1-c313-4241-9999-4a67d4b7a007 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:42.929498 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736286b8-846c-4be1-9103-045f297a4d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:42.930170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736286b8-846c-4be1-9103-045f297a4d50 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:42.930444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736286b8-846c-4be1-9103-045f297a4d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:42.930712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736286b8-846c-4be1-9103-045f297a4d50 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:42.931341 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736286b8-846c-4be1-9103-045f297a4d50 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:42.931641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736286b8-846c-4be1-9103-045f297a4d50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:42.933024 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736286b8-846c-4be1-9103-045f297a4d50 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:42.938256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 496/999] 10.222.0.107 () {56 vars in 1117 bytes} [Tue Aug 23 23:12:42 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:42.943659 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88517a1-f90f-4184-989b-10f46f57b8ce None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:43.034100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:43.056459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88517a1-f90f-4184-989b-10f46f57b8ce None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:43.093709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecceff-e05a-4a08-9764-29a960609286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:43.094367 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecceff-e05a-4a08-9764-29a960609286 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:43.094645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecceff-e05a-4a08-9764-29a960609286 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:43.094914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecceff-e05a-4a08-9764-29a960609286 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:43.095544 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecceff-e05a-4a08-9764-29a960609286 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:43.095848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecceff-e05a-4a08-9764-29a960609286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:43.097235 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecceff-e05a-4a08-9764-29a960609286 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:43.107456 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 504/1000] 10.222.0.107 () {56 vars in 1117 bytes} [Tue Aug 23 23:12:42 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:43.108798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736286b8-846c-4be1-9103-045f297a4d50 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:43.125527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:43.214474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736286b8-846c-4be1-9103-045f297a4d50 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:43.253147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77834dcf-70ee-4461-8756-6083137ba90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:43.253761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77834dcf-70ee-4461-8756-6083137ba90d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:43.254036 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77834dcf-70ee-4461-8756-6083137ba90d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:43.254304 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77834dcf-70ee-4461-8756-6083137ba90d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:43.255006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77834dcf-70ee-4461-8756-6083137ba90d None admin] RBAC: Adding query filter params (interface=public, service_id=5d5ce1392de24bafaf100756bc50a037, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:43.255309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77834dcf-70ee-4461-8756-6083137ba90d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:43.257260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77834dcf-70ee-4461-8756-6083137ba90d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:43.267704 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 497/1001] 10.222.0.107 () {56 vars in 1256 bytes} [Tue Aug 23 23:12:43 2022] GET /identity/v3/endpoints?service_id=5d5ce1392de24bafaf100756bc50a037&interface=public®ion_id=RegionOne => generated 195 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:43.269058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecceff-e05a-4a08-9764-29a960609286 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:43.314690 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e3135-86be-4f72-af53-d6e4ce3d8d3e None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:43.315053 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e3135-86be-4f72-af53-d6e4ce3d8d3e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:43.315280 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e3135-86be-4f72-af53-d6e4ce3d8d3e None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:43.316708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 498/1002] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:12:43.322479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1dd7c0-e0d5-4097-bb6f-b2e47390bfe7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:43.322866 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1dd7c0-e0d5-4097-bb6f-b2e47390bfe7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:43.323191 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1dd7c0-e0d5-4097-bb6f-b2e47390bfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:43.341719 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-cf1dd7c0-e0d5-4097-bb6f-b2e47390bfe7 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:43.342906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cf1dd7c0-e0d5-4097-bb6f-b2e47390bfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:43.377007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecceff-e05a-4a08-9764-29a960609286 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:43.418180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 499/1003] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:43 2022] POST /identity/v3/auth/tokens => generated 1720 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:43.420750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502b853-0176-4ca6-9158-59a24b34c134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:43.421388 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502b853-0176-4ca6-9158-59a24b34c134 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:43.421667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502b853-0176-4ca6-9158-59a24b34c134 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:43.421938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502b853-0176-4ca6-9158-59a24b34c134 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:43.422544 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502b853-0176-4ca6-9158-59a24b34c134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:43.423907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502b853-0176-4ca6-9158-59a24b34c134 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:43.440875 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 505/1004] 10.222.0.107 () {56 vars in 1092 bytes} [Tue Aug 23 23:12:43 2022] GET /identity/v3/services => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:12:43.688096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1dd7c0-e0d5-4097-bb6f-b2e47390bfe7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:43.698423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:43.813756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1dd7c0-e0d5-4097-bb6f-b2e47390bfe7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:43.849892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42dc5a-da75-4d41-9e72-6a83aed8c624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:43.850563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42dc5a-da75-4d41-9e72-6a83aed8c624 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:43.850985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42dc5a-da75-4d41-9e72-6a83aed8c624 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:43.851450 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42dc5a-da75-4d41-9e72-6a83aed8c624 None admin] PATH_INFO: `/v3/services/image` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:43.852107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42dc5a-da75-4d41-9e72-6a83aed8c624 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:43.853527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42dc5a-da75-4d41-9e72-6a83aed8c624 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:43.862383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-ef42dc5a-da75-4d41-9e72-6a83aed8c624 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:12:43.862383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:43.862383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:43.862383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:43.862383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:43.862383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:43.862383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:43.862383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:43.862383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:12:43.862383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:43.862383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:43.862383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:43.862383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:43.862383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:43.862383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:43.862383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:43.862383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:43.863385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:43.863385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:43.863385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:43.863385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:43.863385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:43.863385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:43.863385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:43.863385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:43.863385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:43.863385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:43.863385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:43.863385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:43.863385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:43.863385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:43.863385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:43.863385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:43.864214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:43.864214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:43.864214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:43.864214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:43.864214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:43.864214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:43.864214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:43.864214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:43.864214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:43.864214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:43.864214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:43.864214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:43.864214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:12:43.864214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:43.864214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 500/1005] 10.222.0.107 () {56 vars in 1110 bytes} [Tue Aug 23 23:12:43 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:43.871465 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502b853-0176-4ca6-9158-59a24b34c134 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:43.882845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:44.003726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502b853-0176-4ca6-9158-59a24b34c134 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:44.049670 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febf1d4-2fe2-42cd-9328-0c186beb42d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:44.050648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febf1d4-2fe2-42cd-9328-0c186beb42d0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.051132 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febf1d4-2fe2-42cd-9328-0c186beb42d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.051606 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febf1d4-2fe2-42cd-9328-0c186beb42d0 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.052494 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febf1d4-2fe2-42cd-9328-0c186beb42d0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:44.052964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febf1d4-2fe2-42cd-9328-0c186beb42d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:44.054516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febf1d4-2fe2-42cd-9328-0c186beb42d0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:44.060295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 506/1006] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:43 2022] GET /identity/v3/services?name=image => generated 123 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:44.066888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42dc5a-da75-4d41-9e72-6a83aed8c624 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:44.106027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c75abf-91a3-41c3-b1e8-d240cbe7020f None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.106381 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c75abf-91a3-41c3-b1e8-d240cbe7020f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.106590 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c75abf-91a3-41c3-b1e8-d240cbe7020f None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.107942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 507/1007] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:44.113339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699be235-5b29-4926-8529-b4c37e2fbc73 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.113629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699be235-5b29-4926-8529-b4c37e2fbc73 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.113894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699be235-5b29-4926-8529-b4c37e2fbc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.133886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-699be235-5b29-4926-8529-b4c37e2fbc73 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:44.135098 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-699be235-5b29-4926-8529-b4c37e2fbc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:44.160490 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:44.199315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42dc5a-da75-4d41-9e72-6a83aed8c624 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:44.212658 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 508/1008] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:44 2022] POST /identity/v3/auth/tokens => generated 1720 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:12:44.242179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb19df-9629-471c-b8aa-d15bd1853feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:44.242857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb19df-9629-471c-b8aa-d15bd1853feb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.243138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb19df-9629-471c-b8aa-d15bd1853feb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.243407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb19df-9629-471c-b8aa-d15bd1853feb None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.244046 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb19df-9629-471c-b8aa-d15bd1853feb None admin] RBAC: Adding query filter params (type=image) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:44.244344 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb19df-9629-471c-b8aa-d15bd1853feb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:44.247426 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb19df-9629-471c-b8aa-d15bd1853feb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:44.252350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 501/1009] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:44 2022] GET /identity/v3/services?type=image => generated 123 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:44.498574 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699be235-5b29-4926-8529-b4c37e2fbc73 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:44.500735 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:44.610164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699be235-5b29-4926-8529-b4c37e2fbc73 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:44.652040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2031ab-9e0d-4c70-9aa8-bc8c2e396868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:44.652699 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2031ab-9e0d-4c70-9aa8-bc8c2e396868 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.652978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2031ab-9e0d-4c70-9aa8-bc8c2e396868 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.653255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2031ab-9e0d-4c70-9aa8-bc8c2e396868 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.654361 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2031ab-9e0d-4c70-9aa8-bc8c2e396868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:44.655790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2031ab-9e0d-4c70-9aa8-bc8c2e396868 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:44.657406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 509/1010] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:44 2022] GET /identity/v3/domains/default => generated 200 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:44.664055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb19df-9629-471c-b8aa-d15bd1853feb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:44.767337 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb19df-9629-471c-b8aa-d15bd1853feb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:44.803431 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439af38c-9be2-4274-bedd-686980fe191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:44.804636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439af38c-9be2-4274-bedd-686980fe191b None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.805006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439af38c-9be2-4274-bedd-686980fe191b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.805285 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439af38c-9be2-4274-bedd-686980fe191b None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.805929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439af38c-9be2-4274-bedd-686980fe191b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:44.807354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439af38c-9be2-4274-bedd-686980fe191b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:44.813283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:44.844630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 502/1011] 10.222.0.107 () {60 vars in 1146 bytes} [Tue Aug 23 23:12:44 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:45.392780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e33578-792a-48d3-a84c-c952905df06f None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:45.393345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e33578-792a-48d3-a84c-c952905df06f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:45.393345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e33578-792a-48d3-a84c-c952905df06f None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:45.394805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 510/1012] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:45.400822 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52d6a7-b3ca-4cea-9f3a-487a49454660 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:45.401107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52d6a7-b3ca-4cea-9f3a-487a49454660 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:45.401377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52d6a7-b3ca-4cea-9f3a-487a49454660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:45.420409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7d52d6a7-b3ca-4cea-9f3a-487a49454660 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:45.421623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7d52d6a7-b3ca-4cea-9f3a-487a49454660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:45.491818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 503/1013] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:45 2022] POST /identity/v3/auth/tokens => generated 1720 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:45.762158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e33578-792a-48d3-a84c-c952905df06f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:45.836726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:45.871840 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e33578-792a-48d3-a84c-c952905df06f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:45.907175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6614-1c73-4ab4-9b32-f416ac03564e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:45.907813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6614-1c73-4ab4-9b32-f416ac03564e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:45.908092 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6614-1c73-4ab4-9b32-f416ac03564e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:45.908363 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6614-1c73-4ab4-9b32-f416ac03564e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:45.908973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf6614-1c73-4ab4-9b32-f416ac03564e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:45.910343 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf6614-1c73-4ab4-9b32-f416ac03564e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:45.920298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-2cbf6614-1c73-4ab4-9b32-f416ac03564e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:12:45.920298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:45.920298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:45.920298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:45.920298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:45.920298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:45.920298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:45.920298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:45.920298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:12:45.920298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:45.920298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:45.920298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:45.920298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:45.920298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:45.920298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:45.920298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:45.920298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:45.921366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:45.921366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:45.921366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:45.921366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:45.921366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:45.921366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:45.921366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:45.921366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:45.921366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:45.921366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:45.921366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:45.921366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:45.921366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:45.921366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:45.921366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:45.921366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:45.922211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:45.922211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:45.922211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:45.922211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:45.922211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:45.922211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:45.922211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:45.922211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:45.922211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:45.922211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:45.922211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:45.922211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:45.922211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:12:45.922211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:45.922211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 511/1014] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:45.929964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52d6a7-b3ca-4cea-9f3a-487a49454660 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:46.051629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52d6a7-b3ca-4cea-9f3a-487a49454660 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:46.069738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:46.089638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae4666-f8d6-4005-8c47-93155c434777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:46.090248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae4666-f8d6-4005-8c47-93155c434777 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:46.090524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae4666-f8d6-4005-8c47-93155c434777 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:46.090795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae4666-f8d6-4005-8c47-93155c434777 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:46.091428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae4666-f8d6-4005-8c47-93155c434777 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:46.091728 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae4666-f8d6-4005-8c47-93155c434777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:46.093128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae4666-f8d6-4005-8c47-93155c434777 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:46.102761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 504/1015] 10.222.0.107 () {56 vars in 1117 bytes} [Tue Aug 23 23:12:45 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:46.104030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6614-1c73-4ab4-9b32-f416ac03564e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:46.211827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6614-1c73-4ab4-9b32-f416ac03564e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:46.240849 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18131553-854e-4e48-89b5-d54bd380b23c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:46.241170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18131553-854e-4e48-89b5-d54bd380b23c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:46.241581 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18131553-854e-4e48-89b5-d54bd380b23c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:46.243154 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 505/1016] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:12:46.249786 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e5509-9004-49e0-b178-2a6cd651550b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:46.250077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e5509-9004-49e0-b178-2a6cd651550b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:46.250528 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e5509-9004-49e0-b178-2a6cd651550b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:46.257925 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b49ba2-e56a-42e0-94dc-02232fca2c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:46.259531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b49ba2-e56a-42e0-94dc-02232fca2c5d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:46.259825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b49ba2-e56a-42e0-94dc-02232fca2c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:46.260107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b49ba2-e56a-42e0-94dc-02232fca2c5d None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:46.260779 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b49ba2-e56a-42e0-94dc-02232fca2c5d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:46.261089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b49ba2-e56a-42e0-94dc-02232fca2c5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:46.262478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b49ba2-e56a-42e0-94dc-02232fca2c5d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:46.264031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:46.282678 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-235e5509-9004-49e0-b178-2a6cd651550b None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:46.283186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-235e5509-9004-49e0-b178-2a6cd651550b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:46.284806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 512/1017] 10.222.0.107 () {56 vars in 1117 bytes} [Tue Aug 23 23:12:46 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:46.289703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b49ba2-e56a-42e0-94dc-02232fca2c5d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:46.368825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 506/1018] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:46 2022] POST /identity/v3/auth/tokens => generated 1720 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:12:46.408377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b49ba2-e56a-42e0-94dc-02232fca2c5d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:46.446142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3232ea9-e81f-4ba7-944b-cac9e2c2b407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:46.446756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3232ea9-e81f-4ba7-944b-cac9e2c2b407 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:46.447034 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3232ea9-e81f-4ba7-944b-cac9e2c2b407 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:46.447308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3232ea9-e81f-4ba7-944b-cac9e2c2b407 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:46.447979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3232ea9-e81f-4ba7-944b-cac9e2c2b407 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:46.449375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3232ea9-e81f-4ba7-944b-cac9e2c2b407 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:46.476638 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 513/1019] 10.222.0.107 () {60 vars in 1149 bytes} [Tue Aug 23 23:12:46 2022] POST /identity/v3/endpoints => generated 336 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:12:46.638339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e5509-9004-49e0-b178-2a6cd651550b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:46.755127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e5509-9004-49e0-b178-2a6cd651550b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:46.770840 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:46.801869 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3361037-f8fb-485b-8b12-07da5be6569e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:46.802474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3361037-f8fb-485b-8b12-07da5be6569e None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:46.802747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3361037-f8fb-485b-8b12-07da5be6569e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:46.803018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3361037-f8fb-485b-8b12-07da5be6569e None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:46.803762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3361037-f8fb-485b-8b12-07da5be6569e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:46.805597 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3361037-f8fb-485b-8b12-07da5be6569e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:46.816989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b6c1b-1b5f-46bd-8867-dfcae24bd39d None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:46.817282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b6c1b-1b5f-46bd-8867-dfcae24bd39d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:46.817553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b6c1b-1b5f-46bd-8867-dfcae24bd39d None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:46.820706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 514/1020] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:46.822944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 507/1021] 10.222.0.107 () {60 vars in 1146 bytes} [Tue Aug 23 23:12:46 2022] POST /identity/v3/services => generated 243 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:46.826004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c92093-2853-476e-a4a3-b3824e4ca0c1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:46.826352 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c92093-2853-476e-a4a3-b3824e4ca0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:46.826680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c92093-2853-476e-a4a3-b3824e4ca0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:46.847368 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-13c92093-2853-476e-a4a3-b3824e4ca0c1 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:46.848632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-13c92093-2853-476e-a4a3-b3824e4ca0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:46.911021 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:46.943757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 515/1022] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:46 2022] POST /identity/v3/auth/tokens => generated 1973 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:47.220059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3361037-f8fb-485b-8b12-07da5be6569e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:47.327378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3361037-f8fb-485b-8b12-07da5be6569e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:47.362583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c28cfd-0339-41a5-8887-2c3d0d242fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:47.363287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c28cfd-0339-41a5-8887-2c3d0d242fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:47.363625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c28cfd-0339-41a5-8887-2c3d0d242fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:47.363955 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c28cfd-0339-41a5-8887-2c3d0d242fa6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:47.365145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c28cfd-0339-41a5-8887-2c3d0d242fa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:47.367617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c28cfd-0339-41a5-8887-2c3d0d242fa6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:47.369397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 508/1023] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:47 2022] GET /identity/v3/domains/default => generated 200 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:47.374811 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c92093-2853-476e-a4a3-b3824e4ca0c1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:47.483637 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c92093-2853-476e-a4a3-b3824e4ca0c1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:47.520680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74703dc2-f5ee-484a-86ec-3df5cb4cf085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:47.521299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74703dc2-f5ee-484a-86ec-3df5cb4cf085 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:47.521575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74703dc2-f5ee-484a-86ec-3df5cb4cf085 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:47.521846 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74703dc2-f5ee-484a-86ec-3df5cb4cf085 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:47.522658 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74703dc2-f5ee-484a-86ec-3df5cb4cf085 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:47.524084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74703dc2-f5ee-484a-86ec-3df5cb4cf085 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:47.548419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 516/1024] 10.222.0.107 () {60 vars in 1137 bytes} [Tue Aug 23 23:12:47 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:12:48.527908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022666a-434b-4199-a02a-4d7365ec3091 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:48.528485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022666a-434b-4199-a02a-4d7365ec3091 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:48.528485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022666a-434b-4199-a02a-4d7365ec3091 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:48.529972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 509/1025] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:48.534987 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e75e8f-0f60-43cb-b447-fd8f24557e27 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:48.535398 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e75e8f-0f60-43cb-b447-fd8f24557e27 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:48.535562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e75e8f-0f60-43cb-b447-fd8f24557e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:48.555748 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-98e75e8f-0f60-43cb-b447-fd8f24557e27 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:48.556957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-98e75e8f-0f60-43cb-b447-fd8f24557e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:48.588136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:48.629739 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 517/1026] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:48 2022] POST /identity/v3/auth/tokens => generated 1973 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:48.804495 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184e313-a22e-4506-856d-17e9fc2284e5 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:48.804855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184e313-a22e-4506-856d-17e9fc2284e5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:48.805116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184e313-a22e-4506-856d-17e9fc2284e5 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:48.806597 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 510/1027] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:48.811624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77a8e7-bf24-468a-9bd5-3b7304bb9e8a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:48.811907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77a8e7-bf24-468a-9bd5-3b7304bb9e8a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:48.812179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77a8e7-bf24-468a-9bd5-3b7304bb9e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:48.831100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8d77a8e7-bf24-468a-9bd5-3b7304bb9e8a None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:48.832287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8d77a8e7-bf24-468a-9bd5-3b7304bb9e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:48.899983 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 518/1028] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:48 2022] POST /identity/v3/auth/tokens => generated 1973 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:48.900190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184e313-a22e-4506-856d-17e9fc2284e5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:48.940503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:49.026184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184e313-a22e-4506-856d-17e9fc2284e5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.067603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf312b1-3df0-4d17-ac0e-738ed41a5580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.067603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf312b1-3df0-4d17-ac0e-738ed41a5580 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.067603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf312b1-3df0-4d17-ac0e-738ed41a5580 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.067603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf312b1-3df0-4d17-ac0e-738ed41a5580 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.078449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf312b1-3df0-4d17-ac0e-738ed41a5580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:49.084230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-1cf312b1-3df0-4d17-ac0e-738ed41a5580 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:12:49.084230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:49.084230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:49.084230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:49.084230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:49.084230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:49.084230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:49.084230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:49.084230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:49.084230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:49.084230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:49.084230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:49.084230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:49.084230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:49.084230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:49.084230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:49.087105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:49.087105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:49.087105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:49.087105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:49.087105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:49.087105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:49.087105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:49.087105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:49.087105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:49.087105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:49.087105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:49.087105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:49.087105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:49.087105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:49.087105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:49.087105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:49.088315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:49.088315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:49.088315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:49.088315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:49.088315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:49.088315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:49.088315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:49.088315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:49.088315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:49.088315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:49.088315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:12:49.088315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:49.088315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 511/1029] 10.222.0.107 () {56 vars in 1125 bytes} [Tue Aug 23 23:12:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:49.092806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77a8e7-bf24-468a-9bd5-3b7304bb9e8a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.176073 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf312b1-3df0-4d17-ac0e-738ed41a5580 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.193311 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:49.200627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77a8e7-bf24-468a-9bd5-3b7304bb9e8a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.242696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bc827-6937-4875-8867-5772f5fe1e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.243423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bc827-6937-4875-8867-5772f5fe1e85 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.243700 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bc827-6937-4875-8867-5772f5fe1e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.244089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bc827-6937-4875-8867-5772f5fe1e85 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.244792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bc827-6937-4875-8867-5772f5fe1e85 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:49.245097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bc827-6937-4875-8867-5772f5fe1e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:49.246470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bc827-6937-4875-8867-5772f5fe1e85 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:49.260666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 519/1030] 10.222.0.107 () {56 vars in 1120 bytes} [Tue Aug 23 23:12:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:49.262557 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bc827-6937-4875-8867-5772f5fe1e85 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.282767 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:49.289599 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf312b1-3df0-4d17-ac0e-738ed41a5580 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.327074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756016a8-1ce9-4846-b6c9-81a05e86ac1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.327609 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756016a8-1ce9-4846-b6c9-81a05e86ac1d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.327926 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756016a8-1ce9-4846-b6c9-81a05e86ac1d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.328154 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756016a8-1ce9-4846-b6c9-81a05e86ac1d None admin] PATH_INFO: `/v3/services/image` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.328816 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756016a8-1ce9-4846-b6c9-81a05e86ac1d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:49.330142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756016a8-1ce9-4846-b6c9-81a05e86ac1d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:49.340251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-756016a8-1ce9-4846-b6c9-81a05e86ac1d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:12:49.340251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:49.340251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:49.340251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:49.340251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:49.340251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:49.340251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:49.340251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:49.340251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:12:49.340251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:49.340251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:49.340251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:49.340251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:49.340251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:49.340251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:49.340251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:49.340251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:49.341355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:49.341355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:49.341355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:49.341355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:49.341355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:49.341355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:49.341355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:49.341355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:49.341355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:49.341355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:49.341355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:49.341355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:49.341355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:49.341355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:49.341355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:49.341355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:49.342214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:49.342214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:49.342214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:49.342214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:49.342214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:49.342214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:49.342214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:49.342214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:49.342214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:49.342214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:49.342214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:49.342214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:49.342214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:12:49.342214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:49.342214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 512/1031] 10.222.0.107 () {56 vars in 1110 bytes} [Tue Aug 23 23:12:49 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:49.347276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756016a8-1ce9-4846-b6c9-81a05e86ac1d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.378110 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bc827-6937-4875-8867-5772f5fe1e85 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.416841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a3742-7c01-4344-b26a-f3b4c0958196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.417485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a3742-7c01-4344-b26a-f3b4c0958196 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.417764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a3742-7c01-4344-b26a-f3b4c0958196 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.418033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a3742-7c01-4344-b26a-f3b4c0958196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.430875 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a3742-7c01-4344-b26a-f3b4c0958196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:49.432339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a3742-7c01-4344-b26a-f3b4c0958196 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:49.448312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d88a3742-7c01-4344-b26a-f3b4c0958196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:49.448312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:49.448312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:49.448312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:49.448312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:49.448312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:49.448312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:49.448312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:49.448312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:49.448312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:49.448312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:49.448312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:49.448312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:49.448312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:49.448312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:49.448312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:49.452738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:49.452738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:49.452738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:49.452738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:49.452738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:49.452738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:49.452738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:49.452738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:49.452738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:49.452738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:49.452738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:49.452738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:49.452738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:49.452738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:49.452738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:49.452738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:49.452738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:49.453922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:49.453922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:49.453922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:49.453922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 520/1032] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:49.455232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a3742-7c01-4344-b26a-f3b4c0958196 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.466576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756016a8-1ce9-4846-b6c9-81a05e86ac1d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.468545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:49.508442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd83ca0-64cd-42d8-aaf8-af82b1e03c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.509080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd83ca0-64cd-42d8-aaf8-af82b1e03c93 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.509355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd83ca0-64cd-42d8-aaf8-af82b1e03c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.509620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd83ca0-64cd-42d8-aaf8-af82b1e03c93 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.510307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd83ca0-64cd-42d8-aaf8-af82b1e03c93 None admin] RBAC: Adding query filter params (name=image) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:49.510570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd83ca0-64cd-42d8-aaf8-af82b1e03c93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:49.511930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd83ca0-64cd-42d8-aaf8-af82b1e03c93 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:49.517127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 513/1033] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:49 2022] GET /identity/v3/services?name=image => generated 123 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:49.523082 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd83ca0-64cd-42d8-aaf8-af82b1e03c93 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.550179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:49.575503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a3742-7c01-4344-b26a-f3b4c0958196 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.610450 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdc746-9112-4e35-b2ab-13ca9ef69b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.610968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdc746-9112-4e35-b2ab-13ca9ef69b04 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.611240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdc746-9112-4e35-b2ab-13ca9ef69b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.611512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdc746-9112-4e35-b2ab-13ca9ef69b04 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.612144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdc746-9112-4e35-b2ab-13ca9ef69b04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:49.612443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdc746-9112-4e35-b2ab-13ca9ef69b04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:49.613897 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdc746-9112-4e35-b2ab-13ca9ef69b04 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:49.625746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 521/1034] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:49.626971 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddebc7e-e6b8-450f-b522-fbb5db5e70f4 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.627248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddebc7e-e6b8-450f-b522-fbb5db5e70f4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.627520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddebc7e-e6b8-450f-b522-fbb5db5e70f4 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.628859 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 522/1035] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:49 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:49.631167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddebc7e-e6b8-450f-b522-fbb5db5e70f4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.635771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd83ca0-64cd-42d8-aaf8-af82b1e03c93 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.670808 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3896f-af6b-4943-b2a6-dfc4874831c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.671419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3896f-af6b-4943-b2a6-dfc4874831c0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.671704 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3896f-af6b-4943-b2a6-dfc4874831c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.671966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3896f-af6b-4943-b2a6-dfc4874831c0 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.672610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3896f-af6b-4943-b2a6-dfc4874831c0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:49.672920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3896f-af6b-4943-b2a6-dfc4874831c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:49.674293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3896f-af6b-4943-b2a6-dfc4874831c0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:49.679666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 514/1036] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:49 2022] GET /identity/v3/services?type=image => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:49.681213 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410cdba-3a9c-437f-a930-9ceab04f0a2e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.681359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410cdba-3a9c-437f-a930-9ceab04f0a2e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.681556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410cdba-3a9c-437f-a930-9ceab04f0a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.699706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2410cdba-3a9c-437f-a930-9ceab04f0a2e None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:49.700945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2410cdba-3a9c-437f-a930-9ceab04f0a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:49.704489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:49.736706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddebc7e-e6b8-450f-b522-fbb5db5e70f4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.768881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 515/1037] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:49 2022] POST /identity/v3/auth/tokens => generated 1973 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:49.769736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410cdba-3a9c-437f-a930-9ceab04f0a2e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.785515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781eb56-fe29-47ad-a544-736952a65997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.786685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781eb56-fe29-47ad-a544-736952a65997 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.787134 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781eb56-fe29-47ad-a544-736952a65997 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.787806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781eb56-fe29-47ad-a544-736952a65997 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.789671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:49.798240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781eb56-fe29-47ad-a544-736952a65997 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:49.799676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781eb56-fe29-47ad-a544-736952a65997 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:49.813662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-b781eb56-fe29-47ad-a544-736952a65997 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:12:49.813662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:49.813662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:49.813662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:49.813662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:49.813662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:49.813662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:49.813662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:49.813662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:49.813662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:49.813662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:49.813662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:49.813662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:49.813662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:49.813662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:49.813662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:49.814682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:49.814682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:49.814682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:49.814682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:49.814682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:49.814682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:49.814682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:49.814682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:49.814682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:49.814682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:49.814682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:49.814682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:49.814682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:49.814682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:49.814682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:49.814682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:49.814682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:49.814682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:49.816218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:49.816218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:49.816218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:49.816218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:49.816218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:49.816218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:49.816218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:49.816218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:49.816218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:12:49.816218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:49.816218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 523/1038] 10.222.0.107 () {56 vars in 1098 bytes} [Tue Aug 23 23:12:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:49.821022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781eb56-fe29-47ad-a544-736952a65997 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.879428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410cdba-3a9c-437f-a930-9ceab04f0a2e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.919234 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefe901-b51b-4216-8b66-624d68dbd678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.920525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefe901-b51b-4216-8b66-624d68dbd678 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.920827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefe901-b51b-4216-8b66-624d68dbd678 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.921248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefe901-b51b-4216-8b66-624d68dbd678 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.921959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefe901-b51b-4216-8b66-624d68dbd678 None admin] RBAC: Adding query filter params (interface=public, service_id=a3eae2b1908c4ec2bc773784f51be12e, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:49.922276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefe901-b51b-4216-8b66-624d68dbd678 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:49.923644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefe901-b51b-4216-8b66-624d68dbd678 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:49.932497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781eb56-fe29-47ad-a544-736952a65997 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:49.933742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 516/1039] 10.222.0.107 () {56 vars in 1256 bytes} [Tue Aug 23 23:12:49 2022] GET /identity/v3/endpoints?service_id=a3eae2b1908c4ec2bc773784f51be12e&interface=public®ion_id=RegionOne => generated 195 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:49.934635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefe901-b51b-4216-8b66-624d68dbd678 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:49.963541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:49.970057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb31e03-4540-4d77-959f-4f36dbb8cbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:49.970734 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb31e03-4540-4d77-959f-4f36dbb8cbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:49.971140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb31e03-4540-4d77-959f-4f36dbb8cbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:49.971485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb31e03-4540-4d77-959f-4f36dbb8cbc8 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:49.972338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb31e03-4540-4d77-959f-4f36dbb8cbc8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:49.972752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb31e03-4540-4d77-959f-4f36dbb8cbc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:49.974242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb31e03-4540-4d77-959f-4f36dbb8cbc8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:50.000568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 524/1040] 10.222.0.107 () {56 vars in 1138 bytes} [Tue Aug 23 23:12:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:50.001752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb31e03-4540-4d77-959f-4f36dbb8cbc8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:50.039313 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:50.058298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefe901-b51b-4216-8b66-624d68dbd678 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:50.093176 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe5c12-ac39-4a92-9a3f-8dc31046af67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:50.093855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe5c12-ac39-4a92-9a3f-8dc31046af67 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:50.094165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe5c12-ac39-4a92-9a3f-8dc31046af67 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:50.094344 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe5c12-ac39-4a92-9a3f-8dc31046af67 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:50.095212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe5c12-ac39-4a92-9a3f-8dc31046af67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:50.096285 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe5c12-ac39-4a92-9a3f-8dc31046af67 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:50.103418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 517/1041] 10.222.0.107 () {56 vars in 1092 bytes} [Tue Aug 23 23:12:49 2022] GET /identity/v3/services => generated 1966 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:12:50.104203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe5c12-ac39-4a92-9a3f-8dc31046af67 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:50.114814 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb31e03-4540-4d77-959f-4f36dbb8cbc8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:50.155274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e736fab-cb6c-4eb4-82c7-2dad2634507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:50.155838 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e736fab-cb6c-4eb4-82c7-2dad2634507a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:50.156121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e736fab-cb6c-4eb4-82c7-2dad2634507a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:50.156388 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e736fab-cb6c-4eb4-82c7-2dad2634507a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:50.225324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:50.233507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe5c12-ac39-4a92-9a3f-8dc31046af67 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:50.244006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e736fab-cb6c-4eb4-82c7-2dad2634507a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:50.245990 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e736fab-cb6c-4eb4-82c7-2dad2634507a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:50.277203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72162cd7-e5d5-4a95-9707-5a5739eb36a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:50.278008 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72162cd7-e5d5-4a95-9707-5a5739eb36a9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:50.278292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72162cd7-e5d5-4a95-9707-5a5739eb36a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:50.278894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72162cd7-e5d5-4a95-9707-5a5739eb36a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:50.290372 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72162cd7-e5d5-4a95-9707-5a5739eb36a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:50.295504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-72162cd7-e5d5-4a95-9707-5a5739eb36a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:50.295504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:50.295504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:50.295504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:50.295504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:50.295504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:50.295504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:50.295504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:50.295504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:50.295504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:50.295504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:50.295504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:50.295504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:50.295504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:50.295504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:50.295504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:50.296474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:50.296474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:50.296474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:50.296474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:50.296474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:50.296474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:50.296474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:50.296474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:50.296474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:50.296474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:50.296474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:50.296474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:50.296474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:50.296474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:50.296474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:50.296474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:50.297591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:50.297591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:50.297591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:50.297591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:50.297591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:50.297591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:50.297591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:50.297591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:50.297591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:50.297591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:50.297591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:50.297591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:50.297591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 518/1042] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:50.302571 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72162cd7-e5d5-4a95-9707-5a5739eb36a9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:50.315821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:50.366937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 525/1043] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:12:50 2022] GET /identity/v3/auth/tokens => generated 1973 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:12:50.372736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e736fab-cb6c-4eb4-82c7-2dad2634507a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:50.419479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72162cd7-e5d5-4a95-9707-5a5739eb36a9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:50.456493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf369753-c619-4229-bc97-68b2f8b6c890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:50.457122 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf369753-c619-4229-bc97-68b2f8b6c890 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:50.457397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf369753-c619-4229-bc97-68b2f8b6c890 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:50.457666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf369753-c619-4229-bc97-68b2f8b6c890 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:50.458324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf369753-c619-4229-bc97-68b2f8b6c890 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:50.458619 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf369753-c619-4229-bc97-68b2f8b6c890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:50.460634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf369753-c619-4229-bc97-68b2f8b6c890 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:50.469431 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 519/1044] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:12:50 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:50.471909 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:50.475229 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf369753-c619-4229-bc97-68b2f8b6c890 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:50.487737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e736fab-cb6c-4eb4-82c7-2dad2634507a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:50.527706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51e771-b566-4e04-8111-365f73d8f977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:50.528336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51e771-b566-4e04-8111-365f73d8f977 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:50.528633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51e771-b566-4e04-8111-365f73d8f977 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:50.528892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51e771-b566-4e04-8111-365f73d8f977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:50.540231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51e771-b566-4e04-8111-365f73d8f977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:50.542227 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51e771-b566-4e04-8111-365f73d8f977 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:50.549743 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:50.560232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-df51e771-b566-4e04-8111-365f73d8f977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:50.560232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:50.560232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:50.560232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:50.560232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:50.560232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:50.560232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:50.560232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:50.560232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:50.560232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:50.560232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:50.560232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:50.560232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:50.560232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:50.560232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:50.560232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:50.561300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:50.561300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:50.561300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:50.561300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:50.561300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:50.561300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:50.561300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:50.561300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:50.561300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:50.561300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:50.561300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:50.561300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:50.561300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:50.561300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:50.561300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:50.561300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:50.561300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:50.562203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:50.562203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:50.562203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:50.563056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 526/1045] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:50.566846 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51e771-b566-4e04-8111-365f73d8f977 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:50.591631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf369753-c619-4229-bc97-68b2f8b6c890 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:50.626870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314b0be-d726-4770-8772-0e90b5c78673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:50.627642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314b0be-d726-4770-8772-0e90b5c78673 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:50.627988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314b0be-d726-4770-8772-0e90b5c78673 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:50.628267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314b0be-d726-4770-8772-0e90b5c78673 None admin] PATH_INFO: `/v3/users/6f27989d1f3545e79fcd2a03428caa3c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:50.643886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314b0be-d726-4770-8772-0e90b5c78673 None admin] RBAC: Authorizing `identity:get_user(user_id=6f27989d1f3545e79fcd2a03428caa3c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:50.645366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314b0be-d726-4770-8772-0e90b5c78673 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:50.647244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 520/1046] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:12:50 2022] GET /identity/v3/users/6f27989d1f3545e79fcd2a03428caa3c => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:50.653573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314b0be-d726-4770-8772-0e90b5c78673 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:50.677104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51e771-b566-4e04-8111-365f73d8f977 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:50.712204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4be738-0a01-414c-919c-533214602699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:50.712850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4be738-0a01-414c-919c-533214602699 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:50.713130 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4be738-0a01-414c-919c-533214602699 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:50.713401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4be738-0a01-414c-919c-533214602699 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:50.714052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4be738-0a01-414c-919c-533214602699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:50.714356 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4be738-0a01-414c-919c-533214602699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:50.715713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4be738-0a01-414c-919c-533214602699 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:50.726231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:50.730180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 527/1047] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:50.735512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4be738-0a01-414c-919c-533214602699 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:50.768070 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314b0be-d726-4770-8772-0e90b5c78673 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:50.798236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:50.808276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa888c-0c78-4f9d-aef1-7247a17fe555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:50.809210 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa888c-0c78-4f9d-aef1-7247a17fe555 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:50.809210 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa888c-0c78-4f9d-aef1-7247a17fe555 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:50.809487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa888c-0c78-4f9d-aef1-7247a17fe555 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:50.852255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4be738-0a01-414c-919c-533214602699 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:50.881892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa888c-0c78-4f9d-aef1-7247a17fe555 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:50.883402 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa888c-0c78-4f9d-aef1-7247a17fe555 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:50.888637 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342972f-655b-4e4a-88fc-a6ef1aa493e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:50.889268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342972f-655b-4e4a-88fc-a6ef1aa493e5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:50.889540 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342972f-655b-4e4a-88fc-a6ef1aa493e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:50.889806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342972f-655b-4e4a-88fc-a6ef1aa493e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:50.896529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342972f-655b-4e4a-88fc-a6ef1aa493e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:50.898541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342972f-655b-4e4a-88fc-a6ef1aa493e5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:50.910162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a342972f-655b-4e4a-88fc-a6ef1aa493e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:50.910162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:50.910162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:50.910162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:50.910162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:50.910162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:50.910162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:50.910162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:50.910162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:50.910162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:50.910162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:50.910162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:50.910162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:50.910162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:50.910162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:50.911062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:50.911062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:50.911062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:50.911062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:50.911062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:50.911062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:50.911062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:50.911062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:50.911062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:50.911062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:50.911062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:50.911062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:50.911062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:50.911062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:50.911062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:50.911062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:50.911062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:50.911951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:50.911951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:50.911951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:50.911951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:50.911951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:50.911951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:50.911951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:50.911951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:50.911951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 528/1048] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:50.918095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342972f-655b-4e4a-88fc-a6ef1aa493e5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:50.983862 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:51.008265 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 521/1049] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:12:50 2022] GET /identity/v3/auth/tokens => generated 1973 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 23:12:51.013998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa888c-0c78-4f9d-aef1-7247a17fe555 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:51.032083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342972f-655b-4e4a-88fc-a6ef1aa493e5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:51.042947 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:51.070006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30535f7d-3574-4fb3-997c-2bf6a55e36d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:51.070707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30535f7d-3574-4fb3-997c-2bf6a55e36d3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:51.071147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30535f7d-3574-4fb3-997c-2bf6a55e36d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:51.071402 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30535f7d-3574-4fb3-997c-2bf6a55e36d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:51.072159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30535f7d-3574-4fb3-997c-2bf6a55e36d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:51.072526 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30535f7d-3574-4fb3-997c-2bf6a55e36d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:51.074070 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30535f7d-3574-4fb3-997c-2bf6a55e36d3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:51.092108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 529/1050] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:51.095368 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30535f7d-3574-4fb3-997c-2bf6a55e36d3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:51.132629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa888c-0c78-4f9d-aef1-7247a17fe555 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:51.168115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823ce22-8973-4cb6-b6c4-696609e7eb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:51.168785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823ce22-8973-4cb6-b6c4-696609e7eb3d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:51.169071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823ce22-8973-4cb6-b6c4-696609e7eb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:51.169346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823ce22-8973-4cb6-b6c4-696609e7eb3d None admin] PATH_INFO: `/v3/projects/35655c5fce364e638e5e32e05131c3f7` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:51.170832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823ce22-8973-4cb6-b6c4-696609e7eb3d None admin] RBAC: Authorizing `identity:get_project(project_id=35655c5fce364e638e5e32e05131c3f7)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:51.172269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823ce22-8973-4cb6-b6c4-696609e7eb3d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:51.173942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 522/1051] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:12:51 2022] GET /identity/v3/projects/35655c5fce364e638e5e32e05131c3f7 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:51.179940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823ce22-8973-4cb6-b6c4-696609e7eb3d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:51.205691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30535f7d-3574-4fb3-997c-2bf6a55e36d3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:51.231255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:51.247076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ff35b-fa29-4b19-a43f-c5dc81b7fca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:51.247610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff35b-fa29-4b19-a43f-c5dc81b7fca3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:51.247886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff35b-fa29-4b19-a43f-c5dc81b7fca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:51.248157 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff35b-fa29-4b19-a43f-c5dc81b7fca3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:51.248931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ff35b-fa29-4b19-a43f-c5dc81b7fca3 None admin] RBAC: Adding query filter params (role.id=66e20b7ea4884a8891f2561c6efe905f, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=2f985626d8af4f3089e72998fad98b47) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:51.249230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ff35b-fa29-4b19-a43f-c5dc81b7fca3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:51.250666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ff35b-fa29-4b19-a43f-c5dc81b7fca3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:51.256099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 530/1052] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:12:51 2022] GET /identity/v3/role_assignments?user.id=2f985626d8af4f3089e72998fad98b47&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=66e20b7ea4884a8891f2561c6efe905f => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:51.285830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:51.295483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823ce22-8973-4cb6-b6c4-696609e7eb3d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:51.335537 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e5ec5-c761-4cf9-a4e0-3f9d4e474031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:51.336528 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e5ec5-c761-4cf9-a4e0-3f9d4e474031 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:51.337022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e5ec5-c761-4cf9-a4e0-3f9d4e474031 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:51.337511 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e5ec5-c761-4cf9-a4e0-3f9d4e474031 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:51.338459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e5ec5-c761-4cf9-a4e0-3f9d4e474031 None admin] RBAC: Adding query filter params (role.id=97ece22f2e264e0e857d5107325a85d9, scope.project.id=35655c5fce364e638e5e32e05131c3f7, user.id=6f27989d1f3545e79fcd2a03428caa3c) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:51.338996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e5ec5-c761-4cf9-a4e0-3f9d4e474031 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:51.340674 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e5ec5-c761-4cf9-a4e0-3f9d4e474031 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:51.347575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 523/1053] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:12:51 2022] GET /identity/v3/role_assignments?user.id=6f27989d1f3545e79fcd2a03428caa3c&scope.project.id=35655c5fce364e638e5e32e05131c3f7&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:52.059263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dd50e-6ad9-498d-9d2c-d359c24ff59e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:52.059805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dd50e-6ad9-498d-9d2c-d359c24ff59e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:52.059805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dd50e-6ad9-498d-9d2c-d359c24ff59e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:52.064617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 531/1054] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:52.066668 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738ec10-6d4c-47e4-8dda-5d9a62f22fb9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:52.067100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738ec10-6d4c-47e4-8dda-5d9a62f22fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:52.067267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738ec10-6d4c-47e4-8dda-5d9a62f22fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:52.087105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4738ec10-6d4c-47e4-8dda-5d9a62f22fb9 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:52.088306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4738ec10-6d4c-47e4-8dda-5d9a62f22fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:52.160314 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 524/1055] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:52 2022] POST /identity/v3/auth/tokens => generated 1973 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:52.442322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dd50e-6ad9-498d-9d2c-d359c24ff59e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:52.548952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dd50e-6ad9-498d-9d2c-d359c24ff59e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:52.581846 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacd1c5-8662-4991-91fa-ceca6180d48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:52.582453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacd1c5-8662-4991-91fa-ceca6180d48d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:52.582722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacd1c5-8662-4991-91fa-ceca6180d48d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:52.582986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacd1c5-8662-4991-91fa-ceca6180d48d None admin] PATH_INFO: `/v3/services/image` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:52.583561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacd1c5-8662-4991-91fa-ceca6180d48d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:52.585451 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacd1c5-8662-4991-91fa-ceca6180d48d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:52.593996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-2aacd1c5-8662-4991-91fa-ceca6180d48d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:12:52.593996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:52.593996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:12:52.593996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:12:52.593996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:12:52.593996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:12:52.593996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:12:52.593996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:52.593996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:12:52.593996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:52.593996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:12:52.593996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:52.593996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:52.593996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:52.593996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:52.593996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:52.593996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:52.595006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:52.595006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:52.595006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:52.595006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:52.595006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:52.595006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:52.595006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:12:52.595006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:12:52.595006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:12:52.595006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:12:52.595006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:52.595006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:52.595006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:52.595006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:52.595006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:52.595006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:52.595920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:52.595920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:52.595920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:52.595920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:52.595920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:52.595920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:52.595920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:52.595920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:52.595920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:52.595920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:52.595920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:12:52.595920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:12:52.595920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:12:52.595920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:52.599933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 532/1056] 10.222.0.107 () {56 vars in 1110 bytes} [Tue Aug 23 23:12:52 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:52.602147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738ec10-6d4c-47e4-8dda-5d9a62f22fb9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:52.693685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:52.708044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738ec10-6d4c-47e4-8dda-5d9a62f22fb9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:52.743464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d62c44-5bc1-4dc6-a4f2-8e195a086765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:52.744078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d62c44-5bc1-4dc6-a4f2-8e195a086765 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:52.744354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d62c44-5bc1-4dc6-a4f2-8e195a086765 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:52.744643 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d62c44-5bc1-4dc6-a4f2-8e195a086765 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:52.745298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d62c44-5bc1-4dc6-a4f2-8e195a086765 None admin] RBAC: Adding query filter params (name=image) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:52.745606 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d62c44-5bc1-4dc6-a4f2-8e195a086765 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:52.746952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d62c44-5bc1-4dc6-a4f2-8e195a086765 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:52.756359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 525/1057] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:52 2022] GET /identity/v3/services?name=image => generated 123 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:52.758558 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacd1c5-8662-4991-91fa-ceca6180d48d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:52.810587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:52.865334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacd1c5-8662-4991-91fa-ceca6180d48d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:52.901118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e4e5d-097a-46da-b93d-eaafa1b6603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:52.901725 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e4e5d-097a-46da-b93d-eaafa1b6603f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:52.902000 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e4e5d-097a-46da-b93d-eaafa1b6603f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:52.902268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e4e5d-097a-46da-b93d-eaafa1b6603f None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:52.902922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e4e5d-097a-46da-b93d-eaafa1b6603f None admin] RBAC: Adding query filter params (type=image) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:52.903223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e4e5d-097a-46da-b93d-eaafa1b6603f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:52.904568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e4e5d-097a-46da-b93d-eaafa1b6603f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:52.915075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 533/1058] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:52 2022] GET /identity/v3/services?type=image => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:52.916143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d62c44-5bc1-4dc6-a4f2-8e195a086765 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:53.030947 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d62c44-5bc1-4dc6-a4f2-8e195a086765 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:53.067127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb8bb8-1e57-4b97-bac7-23d469fd317d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:53.067786 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb8bb8-1e57-4b97-bac7-23d469fd317d None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.067999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb8bb8-1e57-4b97-bac7-23d469fd317d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.068273 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb8bb8-1e57-4b97-bac7-23d469fd317d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.069003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb8bb8-1e57-4b97-bac7-23d469fd317d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:53.070621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb8bb8-1e57-4b97-bac7-23d469fd317d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:53.092614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 526/1059] 10.222.0.107 () {60 vars in 1149 bytes} [Tue Aug 23 23:12:52 2022] POST /identity/v3/endpoints => generated 329 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:12:53.191100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3ae45-3430-4c43-b736-8a92bfa1d813 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.191625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3ae45-3430-4c43-b736-8a92bfa1d813 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.191625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3ae45-3430-4c43-b736-8a92bfa1d813 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.193258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 534/1060] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:53.199324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e5111-1b2e-4d4b-b428-5e3391a9b301 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.199623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e5111-1b2e-4d4b-b428-5e3391a9b301 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.199889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e5111-1b2e-4d4b-b428-5e3391a9b301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.221672 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9c1e5111-1b2e-4d4b-b428-5e3391a9b301 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:53.222910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9c1e5111-1b2e-4d4b-b428-5e3391a9b301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:53.225436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:53.295767 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a002ff2-25ff-45fe-9c47-0e0ec61abd49 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.295941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a002ff2-25ff-45fe-9c47-0e0ec61abd49 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.296216 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a002ff2-25ff-45fe-9c47-0e0ec61abd49 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.297603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 535/1061] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:12:53.302806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3fffb-fa5d-4d6f-bcf7-f581857e7a28 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.303099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3fffb-fa5d-4d6f-bcf7-f581857e7a28 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.303367 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3fffb-fa5d-4d6f-bcf7-f581857e7a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.311376 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 527/1062] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:53 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:12:53.324774 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9aa3fffb-fa5d-4d6f-bcf7-f581857e7a28 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:53.325967 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9aa3fffb-fa5d-4d6f-bcf7-f581857e7a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:53.396083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 536/1063] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:53 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:12:53.579872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e5111-1b2e-4d4b-b428-5e3391a9b301 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:53.669632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3fffb-fa5d-4d6f-bcf7-f581857e7a28 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:53.688288 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e5111-1b2e-4d4b-b428-5e3391a9b301 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:53.718121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:53.724463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a8df6-4d71-437b-8104-8cde9feb47d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:53.725128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a8df6-4d71-437b-8104-8cde9feb47d4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.725403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a8df6-4d71-437b-8104-8cde9feb47d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.726179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a8df6-4d71-437b-8104-8cde9feb47d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.728090 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:53.736912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a8df6-4d71-437b-8104-8cde9feb47d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:53.742258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-352a8df6-4d71-437b-8104-8cde9feb47d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:12:53.742258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:53.742258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:53.742258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:53.742258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:53.742258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:53.742258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:53.742258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:53.742258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:53.742258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:53.742258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:53.742258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:53.742258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:53.742258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:53.742258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:53.742258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:53.743205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:53.743205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:53.743205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:53.743205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:53.743205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:53.743205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:53.743205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:53.743205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:53.743205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:53.743205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:53.743205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:53.743205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:53.743205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:53.743205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:53.743205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:53.743205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:53.744882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:53.744882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:53.744882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:53.744882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:53.744882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:53.744882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:53.744882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:53.744882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:53.744882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:53.744882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:53.744882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:12:53.744882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:53.744882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 528/1064] 10.222.0.107 () {56 vars in 1125 bytes} [Tue Aug 23 23:12:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:53.749312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a8df6-4d71-437b-8104-8cde9feb47d4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:53.783706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3fffb-fa5d-4d6f-bcf7-f581857e7a28 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:53.826062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871f5d0-8655-4cce-95dc-ea4644108156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:53.827085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871f5d0-8655-4cce-95dc-ea4644108156 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.827566 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871f5d0-8655-4cce-95dc-ea4644108156 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.828056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871f5d0-8655-4cce-95dc-ea4644108156 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.842100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871f5d0-8655-4cce-95dc-ea4644108156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:53.848291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-b871f5d0-8655-4cce-95dc-ea4644108156 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:53.848291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:53.848291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:53.848291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:53.848291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:53.848291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:53.848291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:53.848291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:53.848291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:53.848291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:53.848291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:53.848291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:53.848291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:53.848291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:53.848291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:53.848291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:53.849386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:53.849386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:53.849386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:53.849386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:53.849386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:53.849386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:53.849386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:53.849386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:53.849386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:53.849386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:53.849386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:53.849386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:53.849386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:53.849386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:53.849386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:53.849386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:53.850269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:53.850269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:53.850269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:53.850269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:53.850269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:53.850269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:53.850269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:53.850269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:53.850269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:53.850269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:53.850269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:53.850269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:53.850269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 537/1065] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:53.855946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871f5d0-8655-4cce-95dc-ea4644108156 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:53.861835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a8df6-4d71-437b-8104-8cde9feb47d4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:53.901113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b88553-69c8-46fe-9a58-28369755a608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:53.901721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b88553-69c8-46fe-9a58-28369755a608 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:53.902000 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b88553-69c8-46fe-9a58-28369755a608 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:53.902271 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b88553-69c8-46fe-9a58-28369755a608 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:53.902937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b88553-69c8-46fe-9a58-28369755a608 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:53.903236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b88553-69c8-46fe-9a58-28369755a608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:53.904708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b88553-69c8-46fe-9a58-28369755a608 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:53.913504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 529/1066] 10.222.0.107 () {56 vars in 1120 bytes} [Tue Aug 23 23:12:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:53.919173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b88553-69c8-46fe-9a58-28369755a608 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:53.979926 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:53.984834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871f5d0-8655-4cce-95dc-ea4644108156 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:53.986891 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:54.026698 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4126bd-3d80-4e9f-9edb-0888fbcb8743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.027309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4126bd-3d80-4e9f-9edb-0888fbcb8743 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.027653 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4126bd-3d80-4e9f-9edb-0888fbcb8743 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.027833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4126bd-3d80-4e9f-9edb-0888fbcb8743 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.028505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4126bd-3d80-4e9f-9edb-0888fbcb8743 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:54.028903 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4126bd-3d80-4e9f-9edb-0888fbcb8743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.030207 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4126bd-3d80-4e9f-9edb-0888fbcb8743 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.032709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b88553-69c8-46fe-9a58-28369755a608 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:54.039242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 538/1067] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:12:53 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:54.045438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4126bd-3d80-4e9f-9edb-0888fbcb8743 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.070816 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59c675-26b5-462d-bcc0-0111a6f6d00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.071590 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59c675-26b5-462d-bcc0-0111a6f6d00c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.071934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59c675-26b5-462d-bcc0-0111a6f6d00c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.072279 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59c675-26b5-462d-bcc0-0111a6f6d00c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.084747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59c675-26b5-462d-bcc0-0111a6f6d00c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.085932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59c675-26b5-462d-bcc0-0111a6f6d00c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.100543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-bb59c675-26b5-462d-bcc0-0111a6f6d00c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:54.100543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:54.100543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:54.100543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:54.100543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:54.100543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:54.100543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:54.100543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:54.100543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:54.100543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:54.100543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:54.100543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:54.100543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:54.100543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:54.100543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:54.100543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:54.101723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:54.101723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:54.101723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:54.101723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:54.101723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:54.101723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:54.101723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:54.101723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:54.101723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:54.101723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:54.101723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:54.101723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:54.101723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:54.101723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:54.101723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:54.101723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:54.101723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:54.102616 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:54.102616 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:54.102616 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:54.102616 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 530/1068] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:54.108261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59c675-26b5-462d-bcc0-0111a6f6d00c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.162672 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4126bd-3d80-4e9f-9edb-0888fbcb8743 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:54.200258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e7f9c-12b2-4ed5-ad5d-08041cd4805f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.200938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e7f9c-12b2-4ed5-ad5d-08041cd4805f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.201246 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e7f9c-12b2-4ed5-ad5d-08041cd4805f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.201448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e7f9c-12b2-4ed5-ad5d-08041cd4805f None admin] PATH_INFO: `/v3/users/6f27989d1f3545e79fcd2a03428caa3c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.202583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e7f9c-12b2-4ed5-ad5d-08041cd4805f None admin] RBAC: Authorizing `identity:get_user(user_id=6f27989d1f3545e79fcd2a03428caa3c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.204027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e7f9c-12b2-4ed5-ad5d-08041cd4805f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.205786 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 539/1069] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:12:54 2022] GET /identity/v3/users/6f27989d1f3545e79fcd2a03428caa3c => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:54.212817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e7f9c-12b2-4ed5-ad5d-08041cd4805f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.216245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59c675-26b5-462d-bcc0-0111a6f6d00c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:54.227068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:54.252538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:54.256885 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd599f07-5d75-4895-91c5-9c207ae08f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.257901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd599f07-5d75-4895-91c5-9c207ae08f9a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.257901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd599f07-5d75-4895-91c5-9c207ae08f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.258077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd599f07-5d75-4895-91c5-9c207ae08f9a None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.258725 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd599f07-5d75-4895-91c5-9c207ae08f9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:54.259033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd599f07-5d75-4895-91c5-9c207ae08f9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.260397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd599f07-5d75-4895-91c5-9c207ae08f9a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.274484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 531/1070] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:54.280895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd599f07-5d75-4895-91c5-9c207ae08f9a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.330642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e7f9c-12b2-4ed5-ad5d-08041cd4805f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:54.377816 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc116cc-ce67-45ab-bc9a-5c31bf253eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.378364 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc116cc-ce67-45ab-bc9a-5c31bf253eff None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.378637 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc116cc-ce67-45ab-bc9a-5c31bf253eff None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.378901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc116cc-ce67-45ab-bc9a-5c31bf253eff None admin] PATH_INFO: `/v3/projects/35655c5fce364e638e5e32e05131c3f7` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.380129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc116cc-ce67-45ab-bc9a-5c31bf253eff None admin] RBAC: Authorizing `identity:get_project(project_id=35655c5fce364e638e5e32e05131c3f7)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.382922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc116cc-ce67-45ab-bc9a-5c31bf253eff None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.384968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 540/1071] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:12:54 2022] GET /identity/v3/projects/35655c5fce364e638e5e32e05131c3f7 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:54.390589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc116cc-ce67-45ab-bc9a-5c31bf253eff None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.406096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd599f07-5d75-4895-91c5-9c207ae08f9a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:54.443755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a524940-a032-4142-91a6-a79b9b98e3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.444532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a524940-a032-4142-91a6-a79b9b98e3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.444899 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a524940-a032-4142-91a6-a79b9b98e3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.445180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a524940-a032-4142-91a6-a79b9b98e3d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.453624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a524940-a032-4142-91a6-a79b9b98e3d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.455095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a524940-a032-4142-91a6-a79b9b98e3d7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.467212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3a524940-a032-4142-91a6-a79b9b98e3d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:12:54.467212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:54.467212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:54.467212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:54.467212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:54.467212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:54.467212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:54.467212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:54.467212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:54.467212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:54.467212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:54.467212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:54.467212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:54.467212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:54.467212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:54.467212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:54.468203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:54.468203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:54.468203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:54.468203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:54.468203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:54.468203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:54.468203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:54.468203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:54.468203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:54.468203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:54.468203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:54.468203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:54.468203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:54.468203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:54.468203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:54.468203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:54.468203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:54.468203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:54.469244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:54.469244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:54.469244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:54.469244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:54.469244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:54.469244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:54.469244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:54.469244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:54.469244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:12:54.469244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:54.469244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 532/1072] 10.222.0.107 () {56 vars in 1098 bytes} [Tue Aug 23 23:12:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:54.473962 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a524940-a032-4142-91a6-a79b9b98e3d7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.504264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:54.506775 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:54.507561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc116cc-ce67-45ab-bc9a-5c31bf253eff None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:54.542155 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f8981-3553-4991-b40b-86df4f41eb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.542815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f8981-3553-4991-b40b-86df4f41eb90 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.543092 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f8981-3553-4991-b40b-86df4f41eb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.543361 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f8981-3553-4991-b40b-86df4f41eb90 None admin] PATH_INFO: `/v3/projects/35655c5fce364e638e5e32e05131c3f7/users/6f27989d1f3545e79fcd2a03428caa3c/roles/97ece22f2e264e0e857d5107325a85d9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.545566 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f8981-3553-4991-b40b-86df4f41eb90 None admin] RBAC: Authorizing `identity:create_grant(project_id=35655c5fce364e638e5e32e05131c3f7, user_id=6f27989d1f3545e79fcd2a03428caa3c, role_id=97ece22f2e264e0e857d5107325a85d9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.546978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f8981-3553-4991-b40b-86df4f41eb90 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.564045 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 541/1073] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:12:54 2022] PUT /identity/v3/projects/35655c5fce364e638e5e32e05131c3f7/users/6f27989d1f3545e79fcd2a03428caa3c/roles/97ece22f2e264e0e857d5107325a85d9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:12:54.594211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a524940-a032-4142-91a6-a79b9b98e3d7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:54.636031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9071f2-7e13-419b-8af2-53952dfd436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.636703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9071f2-7e13-419b-8af2-53952dfd436f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.636988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9071f2-7e13-419b-8af2-53952dfd436f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.637264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9071f2-7e13-419b-8af2-53952dfd436f None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.638022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9071f2-7e13-419b-8af2-53952dfd436f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:54.638334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9071f2-7e13-419b-8af2-53952dfd436f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.639810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9071f2-7e13-419b-8af2-53952dfd436f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.661795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 533/1074] 10.222.0.107 () {56 vars in 1138 bytes} [Tue Aug 23 23:12:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:54.667763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f8981-3553-4991-b40b-86df4f41eb90 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.780735 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f8981-3553-4991-b40b-86df4f41eb90 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:54.815428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef6e4d-6334-4a65-bc64-35c8d909f266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:54.816060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef6e4d-6334-4a65-bc64-35c8d909f266 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.816338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef6e4d-6334-4a65-bc64-35c8d909f266 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.816621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef6e4d-6334-4a65-bc64-35c8d909f266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.827749 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef6e4d-6334-4a65-bc64-35c8d909f266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:54.829418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef6e4d-6334-4a65-bc64-35c8d909f266 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:54.844922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-6fef6e4d-6334-4a65-bc64-35c8d909f266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:54.844922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:54.844922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:54.844922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:54.844922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:54.844922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:54.844922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:54.844922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:54.844922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:54.844922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:54.844922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:54.844922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:54.844922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:54.844922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:54.844922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:54.844922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:54.845941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:54.845941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:54.845941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:54.845941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:54.845941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:54.845941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:54.845941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:54.845941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:54.845941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:54.845941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:54.845941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:54.845941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:54.845941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:54.845941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:54.845941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:54.845941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:54.845941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:54.846842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:54.846842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:54.846842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:54.846842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 542/1075] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:54.852517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9071f2-7e13-419b-8af2-53952dfd436f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.947764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:54.964096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9071f2-7e13-419b-8af2-53952dfd436f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:55.005297 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c9a75-8721-4e89-8cc6-888a02d4ee80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:55.005908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c9a75-8721-4e89-8cc6-888a02d4ee80 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.006182 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c9a75-8721-4e89-8cc6-888a02d4ee80 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.006452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c9a75-8721-4e89-8cc6-888a02d4ee80 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.008006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c9a75-8721-4e89-8cc6-888a02d4ee80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:55.008338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c9a75-8721-4e89-8cc6-888a02d4ee80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:55.009732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c9a75-8721-4e89-8cc6-888a02d4ee80 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:55.027307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 534/1076] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:55.028893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef6e4d-6334-4a65-bc64-35c8d909f266 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:55.047323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:55.084282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea4fad-d2a5-4f32-9e98-aab09574fab4 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.085002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea4fad-d2a5-4f32-9e98-aab09574fab4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.085002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea4fad-d2a5-4f32-9e98-aab09574fab4 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.086843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 535/1077] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:12:55.092141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c54a7-55b8-4b28-a26f-d44e7dc48ee1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.092141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c54a7-55b8-4b28-a26f-d44e7dc48ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.092400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c54a7-55b8-4b28-a26f-d44e7dc48ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.110244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5d0c54a7-55b8-4b28-a26f-d44e7dc48ee1 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:55.111428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5d0c54a7-55b8-4b28-a26f-d44e7dc48ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:55.147402 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef6e4d-6334-4a65-bc64-35c8d909f266 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:55.184061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 536/1078] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:55 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:12:55.184272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689932d0-0f42-4396-b7d3-d66b1fe0a897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:55.184852 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689932d0-0f42-4396-b7d3-d66b1fe0a897 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.185133 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689932d0-0f42-4396-b7d3-d66b1fe0a897 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.185397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689932d0-0f42-4396-b7d3-d66b1fe0a897 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.192555 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689932d0-0f42-4396-b7d3-d66b1fe0a897 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:55.194145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689932d0-0f42-4396-b7d3-d66b1fe0a897 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:55.205710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-689932d0-0f42-4396-b7d3-d66b1fe0a897 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:55.205710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:55.205710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:55.205710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:55.205710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:55.205710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:55.205710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:55.205710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:55.205710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:55.205710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:55.205710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:55.205710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:55.205710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:55.205710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:55.205710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:55.212391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:55.212391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:55.212391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:55.212391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:55.212391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:55.212391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:55.212391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:55.212391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:55.212391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:55.212391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:55.212391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:55.212391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:55.212391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:55.212391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:55.212391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:55.212391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:55.212391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:55.213631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:55.213631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:55.213631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:55.213631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:55.213631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:55.213631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:55.213631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:55.213631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:55.213631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 543/1079] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:55.214166 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c54a7-55b8-4b28-a26f-d44e7dc48ee1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:55.295575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:55.320759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c54a7-55b8-4b28-a26f-d44e7dc48ee1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:55.355326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9e3d0-bd7e-46bf-b437-07af28fcf487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:55.355930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9e3d0-bd7e-46bf-b437-07af28fcf487 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.356208 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9e3d0-bd7e-46bf-b437-07af28fcf487 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.356478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9e3d0-bd7e-46bf-b437-07af28fcf487 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.357203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9e3d0-bd7e-46bf-b437-07af28fcf487 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:55.357506 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9e3d0-bd7e-46bf-b437-07af28fcf487 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:55.358923 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9e3d0-bd7e-46bf-b437-07af28fcf487 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:55.376035 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 537/1080] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:55.377199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689932d0-0f42-4396-b7d3-d66b1fe0a897 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:55.450575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:55.454264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9e3d0-bd7e-46bf-b437-07af28fcf487 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:55.489283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689932d0-0f42-4396-b7d3-d66b1fe0a897 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:55.526191 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa19e0-7b6e-4877-9479-a236555cbebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:55.527024 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa19e0-7b6e-4877-9479-a236555cbebf None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.527305 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa19e0-7b6e-4877-9479-a236555cbebf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.527575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa19e0-7b6e-4877-9479-a236555cbebf None admin] PATH_INFO: `/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/2f985626d8af4f3089e72998fad98b47/roles/66e20b7ea4884a8891f2561c6efe905f` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.531086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa19e0-7b6e-4877-9479-a236555cbebf None admin] RBAC: Authorizing `identity:create_grant(project_id=f7cdd07c79614516be35aa2d82ec6a3b, user_id=2f985626d8af4f3089e72998fad98b47, role_id=66e20b7ea4884a8891f2561c6efe905f)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:55.532531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa19e0-7b6e-4877-9479-a236555cbebf None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:55.567303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 544/1081] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:12:55 2022] PUT /identity/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/2f985626d8af4f3089e72998fad98b47/roles/66e20b7ea4884a8891f2561c6efe905f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:12:55.580781 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9e3d0-bd7e-46bf-b437-07af28fcf487 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:55.620993 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ab45d-6941-47f2-9100-b64f06db3637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:55.621589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ab45d-6941-47f2-9100-b64f06db3637 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.621837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ab45d-6941-47f2-9100-b64f06db3637 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.622114 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ab45d-6941-47f2-9100-b64f06db3637 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.627251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:55.710960 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ab45d-6941-47f2-9100-b64f06db3637 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:55.712624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ab45d-6941-47f2-9100-b64f06db3637 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:55.816457 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 538/1082] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:12:55 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 23:12:55.822181 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa19e0-7b6e-4877-9479-a236555cbebf None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:55.928282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa19e0-7b6e-4877-9479-a236555cbebf None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:55.958508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:55.965208 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e1aa1-9470-448c-b89d-7e4b2c0c77d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:55.966282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e1aa1-9470-448c-b89d-7e4b2c0c77d5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.966794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e1aa1-9470-448c-b89d-7e4b2c0c77d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.967385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e1aa1-9470-448c-b89d-7e4b2c0c77d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.979632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e1aa1-9470-448c-b89d-7e4b2c0c77d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:55.983733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e1aa1-9470-448c-b89d-7e4b2c0c77d5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:56.000625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-0b7e1aa1-9470-448c-b89d-7e4b2c0c77d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:56.000625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:56.000625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:56.000625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:56.000625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:56.000625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:56.000625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:56.000625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:56.000625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:56.000625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:56.000625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:56.000625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:56.000625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:56.000625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:56.000625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:56.000625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:56.001569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:56.001569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:56.001569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:56.001569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:56.001569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:56.001569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:56.001569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:56.001569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:56.001569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:56.001569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:56.001569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:56.001569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:56.001569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:56.001569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:56.001569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:56.001569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:56.001569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:56.002474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:56.002474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:56.002474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:56.002474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 545/1083] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:56.009293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ab45d-6941-47f2-9100-b64f06db3637 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:56.045880 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:56.114805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ab45d-6941-47f2-9100-b64f06db3637 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:56.150904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824c989-5d2e-435b-a8b0-ebc53def4832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:56.151504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824c989-5d2e-435b-a8b0-ebc53def4832 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:56.151778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824c989-5d2e-435b-a8b0-ebc53def4832 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:56.152045 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824c989-5d2e-435b-a8b0-ebc53def4832 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:56.152712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824c989-5d2e-435b-a8b0-ebc53def4832 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:56.153012 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824c989-5d2e-435b-a8b0-ebc53def4832 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:56.154373 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824c989-5d2e-435b-a8b0-ebc53def4832 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:56.172645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 539/1084] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:56.551708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1802f-99a0-425e-9d24-6f56c8c34bac None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:56.552258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1802f-99a0-425e-9d24-6f56c8c34bac None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:56.552258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1802f-99a0-425e-9d24-6f56c8c34bac None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:56.553664 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 546/1085] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:56.559183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd6d3d-0290-438d-a230-b0a820c3869e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:56.559468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd6d3d-0290-438d-a230-b0a820c3869e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:56.559748 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd6d3d-0290-438d-a230-b0a820c3869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:56.578337 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5bcd6d3d-0290-438d-a230-b0a820c3869e None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:56.579529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5bcd6d3d-0290-438d-a230-b0a820c3869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:56.648633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 540/1086] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:56 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:12:56.917457 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1802f-99a0-425e-9d24-6f56c8c34bac None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:57.026354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1802f-99a0-425e-9d24-6f56c8c34bac None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:57.061894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e3451-7431-48d0-888c-e1b8ff4734a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:57.062520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e3451-7431-48d0-888c-e1b8ff4734a3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:57.062794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e3451-7431-48d0-888c-e1b8ff4734a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:57.063061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e3451-7431-48d0-888c-e1b8ff4734a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:57.074678 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e3451-7431-48d0-888c-e1b8ff4734a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:57.079331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-326e3451-7431-48d0-888c-e1b8ff4734a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:57.079331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:57.079331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:57.079331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:57.079331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:57.079331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:57.079331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:57.079331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:57.079331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:57.079331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:57.079331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:57.079331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:57.079331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:57.079331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:57.079331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:57.079331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:57.080464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:57.080464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:57.080464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:57.080464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:57.080464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:57.080464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:57.080464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:57.080464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:57.080464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:57.080464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:57.080464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:57.080464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:57.080464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:57.080464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:57.080464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:57.080464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:57.081738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:57.081738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:57.081738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:57.081738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:57.081738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:57.081738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:57.081738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:57.081738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:57.081738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:57.081738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:57.081738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:12:57.081738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:57.081738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 547/1087] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:12:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:57.086423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd6d3d-0290-438d-a230-b0a820c3869e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:57.112890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:57.187521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd6d3d-0290-438d-a230-b0a820c3869e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:57.221568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35326b-1aef-4b04-a484-1d856c377566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:57.222201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35326b-1aef-4b04-a484-1d856c377566 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:57.222477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35326b-1aef-4b04-a484-1d856c377566 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:57.222749 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35326b-1aef-4b04-a484-1d856c377566 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:57.223416 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35326b-1aef-4b04-a484-1d856c377566 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:57.223791 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35326b-1aef-4b04-a484-1d856c377566 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:57.225118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35326b-1aef-4b04-a484-1d856c377566 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:57.233812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 541/1088] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:12:57 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:57.239563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e3451-7431-48d0-888c-e1b8ff4734a3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:57.285355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:57.341243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e3451-7431-48d0-888c-e1b8ff4734a3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:57.373879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb31c8d-32b6-4284-8bec-00e9c1952203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:57.374502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb31c8d-32b6-4284-8bec-00e9c1952203 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:57.374776 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb31c8d-32b6-4284-8bec-00e9c1952203 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:57.375042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb31c8d-32b6-4284-8bec-00e9c1952203 None admin] PATH_INFO: `/v3/users/6f27989d1f3545e79fcd2a03428caa3c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:57.376142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb31c8d-32b6-4284-8bec-00e9c1952203 None admin] RBAC: Authorizing `identity:get_user(user_id=6f27989d1f3545e79fcd2a03428caa3c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:57.377605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb31c8d-32b6-4284-8bec-00e9c1952203 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:57.379184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 548/1089] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:12:57 2022] GET /identity/v3/users/6f27989d1f3545e79fcd2a03428caa3c => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:57.385643 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35326b-1aef-4b04-a484-1d856c377566 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:57.473902 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:57.487057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35326b-1aef-4b04-a484-1d856c377566 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:57.520656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb7aee-8204-4a7f-bee7-fe4513162ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:57.521254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb7aee-8204-4a7f-bee7-fe4513162ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:57.521525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb7aee-8204-4a7f-bee7-fe4513162ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:57.521789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb7aee-8204-4a7f-bee7-fe4513162ed1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:57.529597 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f71e90-e955-422d-8de1-8a8643c9df66 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:57.529882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f71e90-e955-422d-8de1-8a8643c9df66 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:57.530162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f71e90-e955-422d-8de1-8a8643c9df66 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:57.531513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 549/1090] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:12:57.536448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2829f-1ce1-4300-a199-9f62e7ddcb91 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:57.536741 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2829f-1ce1-4300-a199-9f62e7ddcb91 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:57.537019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2829f-1ce1-4300-a199-9f62e7ddcb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:57.557249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f0a2829f-1ce1-4300-a199-9f62e7ddcb91 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:57.558445 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f0a2829f-1ce1-4300-a199-9f62e7ddcb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:57.592874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb7aee-8204-4a7f-bee7-fe4513162ed1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:57.594322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb7aee-8204-4a7f-bee7-fe4513162ed1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:57.626611 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 550/1091] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:57 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:12:57.682518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:57.695648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 542/1092] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:12:57 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:12:57.701576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2829f-1ce1-4300-a199-9f62e7ddcb91 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:57.745792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:57.803197 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2829f-1ce1-4300-a199-9f62e7ddcb91 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:57.839136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171339df-0e83-444b-a368-2883fa9af900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:57.840202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171339df-0e83-444b-a368-2883fa9af900 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:57.840730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171339df-0e83-444b-a368-2883fa9af900 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:57.841160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171339df-0e83-444b-a368-2883fa9af900 None admin] PATH_INFO: `/v3/projects/35655c5fce364e638e5e32e05131c3f7` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:57.842560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171339df-0e83-444b-a368-2883fa9af900 None admin] RBAC: Authorizing `identity:get_project(project_id=35655c5fce364e638e5e32e05131c3f7)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:57.843985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171339df-0e83-444b-a368-2883fa9af900 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:57.845663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 551/1093] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:12:57 2022] GET /identity/v3/projects/35655c5fce364e638e5e32e05131c3f7 => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:57.852405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb7aee-8204-4a7f-bee7-fe4513162ed1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:57.902584 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171339df-0e83-444b-a368-2883fa9af900 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:57.955492 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb7aee-8204-4a7f-bee7-fe4513162ed1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:57.992836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac90c4-636d-4ca0-b140-13f07645a421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:57.993563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac90c4-636d-4ca0-b140-13f07645a421 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:57.993849 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac90c4-636d-4ca0-b140-13f07645a421 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:57.994122 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac90c4-636d-4ca0-b140-13f07645a421 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:57.994891 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac90c4-636d-4ca0-b140-13f07645a421 None admin] RBAC: Adding query filter params (role.id=97ece22f2e264e0e857d5107325a85d9, scope.project.id=35655c5fce364e638e5e32e05131c3f7, user.id=6f27989d1f3545e79fcd2a03428caa3c) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:57.995155 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac90c4-636d-4ca0-b140-13f07645a421 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:57.996701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac90c4-636d-4ca0-b140-13f07645a421 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:58.002746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 543/1094] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:12:57 2022] GET /identity/v3/role_assignments?user.id=6f27989d1f3545e79fcd2a03428caa3c&scope.project.id=35655c5fce364e638e5e32e05131c3f7&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 610 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:58.008845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171339df-0e83-444b-a368-2883fa9af900 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:58.021429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:58.049475 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd6485-2b7a-4611-a197-e63beb05f82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:58.050124 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd6485-2b7a-4611-a197-e63beb05f82c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:58.050403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd6485-2b7a-4611-a197-e63beb05f82c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:58.050672 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd6485-2b7a-4611-a197-e63beb05f82c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:58.063686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd6485-2b7a-4611-a197-e63beb05f82c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:12:58.068676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-7bcd6485-2b7a-4611-a197-e63beb05f82c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:12:58.068676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:58.068676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:58.068676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:58.068676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:58.068676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:58.068676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:58.068676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:58.068676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:58.068676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:58.068676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:58.068676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:58.068676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:12:58.068676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:12:58.068676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:12:58.068676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:12:58.069733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:12:58.069733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:12:58.069733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:12:58.069733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:12:58.069733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:58.069733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:58.069733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:58.069733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:58.069733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:58.069733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:58.069733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:58.069733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:58.069733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:58.069733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:58.069733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:58.069733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:58.070585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:58.070585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:58.070585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:58.070585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:58.070585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:12:58.070585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:12:58.070585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:12:58.070585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:12:58.070585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:12:58.070585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:12:58.070585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:12:58.070585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:58.070585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 552/1095] 10.222.0.107 () {56 vars in 1125 bytes} [Tue Aug 23 23:12:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:58.077100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac90c4-636d-4ca0-b140-13f07645a421 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:58.135041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:58.191931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac90c4-636d-4ca0-b140-13f07645a421 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:58.227862 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb2da6-63bd-4e25-a2b2-d12374fefa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:58.228471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb2da6-63bd-4e25-a2b2-d12374fefa49 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:58.228781 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb2da6-63bd-4e25-a2b2-d12374fefa49 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:58.229123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb2da6-63bd-4e25-a2b2-d12374fefa49 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:58.229722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb2da6-63bd-4e25-a2b2-d12374fefa49 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:58.230026 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb2da6-63bd-4e25-a2b2-d12374fefa49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:58.231395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb2da6-63bd-4e25-a2b2-d12374fefa49 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:58.239737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 544/1096] 10.222.0.107 () {56 vars in 1120 bytes} [Tue Aug 23 23:12:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:58.246074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd6485-2b7a-4611-a197-e63beb05f82c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:58.348384 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd6485-2b7a-4611-a197-e63beb05f82c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:58.382621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee9fa8-95fb-4006-ba3d-49a4396129a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:58.383237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9fa8-95fb-4006-ba3d-49a4396129a3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:58.383509 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9fa8-95fb-4006-ba3d-49a4396129a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:58.383774 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9fa8-95fb-4006-ba3d-49a4396129a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:58.393573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee9fa8-95fb-4006-ba3d-49a4396129a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:58.394999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee9fa8-95fb-4006-ba3d-49a4396129a3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:58.410359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-6cee9fa8-95fb-4006-ba3d-49a4396129a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:58.410359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:58.410359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:58.410359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:58.410359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:58.410359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:58.410359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:58.410359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:58.410359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:58.410359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:58.410359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:58.410359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:58.410359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:58.410359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:58.410359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:58.410359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:58.411575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:58.411575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:58.411575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:58.411575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:58.411575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:58.411575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:58.411575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:58.411575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:58.411575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:58.411575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:58.411575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:58.411575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:58.411575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:58.411575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:58.411575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:58.411575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:58.411575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:58.413006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:58.413006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:58.413006 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:58.416626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 553/1097] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:12:58.417840 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb2da6-63bd-4e25-a2b2-d12374fefa49 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:58.520221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb2da6-63bd-4e25-a2b2-d12374fefa49 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:58.533947 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:58.555882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a836b29-a853-4d1c-a173-8522d6a79257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:58.556797 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a836b29-a853-4d1c-a173-8522d6a79257 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:58.557084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a836b29-a853-4d1c-a173-8522d6a79257 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:58.557360 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a836b29-a853-4d1c-a173-8522d6a79257 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:58.558005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a836b29-a853-4d1c-a173-8522d6a79257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:58.558311 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a836b29-a853-4d1c-a173-8522d6a79257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:58.559686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a836b29-a853-4d1c-a173-8522d6a79257 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:58.572187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 545/1098] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:58.577851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee9fa8-95fb-4006-ba3d-49a4396129a3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:58.603658 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:58.681089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee9fa8-95fb-4006-ba3d-49a4396129a3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:58.715188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b7261-aea4-4e0a-af57-4239a2aa3f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:58.715802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b7261-aea4-4e0a-af57-4239a2aa3f97 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:58.716075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b7261-aea4-4e0a-af57-4239a2aa3f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:58.716342 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b7261-aea4-4e0a-af57-4239a2aa3f97 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:58.723563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b7261-aea4-4e0a-af57-4239a2aa3f97 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:58.725027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b7261-aea4-4e0a-af57-4239a2aa3f97 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:58.736709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-925b7261-aea4-4e0a-af57-4239a2aa3f97 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:12:58.736709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:58.736709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:58.736709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:58.736709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:58.736709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:58.736709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:58.736709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:58.736709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:58.736709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:58.736709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:58.736709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:58.736709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:12:58.736709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:12:58.736709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:12:58.736709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:12:58.737851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:58.737851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:58.737851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:12:58.737851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:58.737851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:12:58.737851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:12:58.737851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:58.737851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:58.737851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:58.737851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:58.737851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:58.737851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:58.737851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:58.737851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:58.737851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:58.737851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:58.737851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:58.737851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:58.738824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:58.738824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:58.738824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:12:58.738824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:12:58.738824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:12:58.738824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:12:58.738824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:12:58.738824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:12:58.738824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:12:58.738824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:12:58.738824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 554/1099] 10.222.0.107 () {56 vars in 1098 bytes} [Tue Aug 23 23:12:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:58.744316 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a836b29-a853-4d1c-a173-8522d6a79257 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:58.843487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a836b29-a853-4d1c-a173-8522d6a79257 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:58.879382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a388f-97af-400f-b939-d570cb25e8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:58.879892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a388f-97af-400f-b939-d570cb25e8fe None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:58.880166 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a388f-97af-400f-b939-d570cb25e8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:58.880434 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a388f-97af-400f-b939-d570cb25e8fe None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:58.881189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a388f-97af-400f-b939-d570cb25e8fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:58.881492 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a388f-97af-400f-b939-d570cb25e8fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:58.883263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a388f-97af-400f-b939-d570cb25e8fe None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:58.900431 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 546/1100] 10.222.0.107 () {56 vars in 1138 bytes} [Tue Aug 23 23:12:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:12:58.906266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b7261-aea4-4e0a-af57-4239a2aa3f97 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:58.988913 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:59.009398 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b7261-aea4-4e0a-af57-4239a2aa3f97 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:59.043290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c4387-9e08-43ba-afd8-8a74b9b8a54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:59.043893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c4387-9e08-43ba-afd8-8a74b9b8a54a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.044166 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c4387-9e08-43ba-afd8-8a74b9b8a54a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.044434 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c4387-9e08-43ba-afd8-8a74b9b8a54a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.113371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c4387-9e08-43ba-afd8-8a74b9b8a54a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:59.114809 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c4387-9e08-43ba-afd8-8a74b9b8a54a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:59.196477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:59.215634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 555/1101] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:12:58 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 23:12:59.221408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a388f-97af-400f-b939-d570cb25e8fe None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:59.256160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:59.328039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a388f-97af-400f-b939-d570cb25e8fe None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:59.360906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a176d8-3eb9-47b1-b799-4c3101c20663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:59.361523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a176d8-3eb9-47b1-b799-4c3101c20663 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.361796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a176d8-3eb9-47b1-b799-4c3101c20663 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.362064 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a176d8-3eb9-47b1-b799-4c3101c20663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.372396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a176d8-3eb9-47b1-b799-4c3101c20663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:59.373865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a176d8-3eb9-47b1-b799-4c3101c20663 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:59.388281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-01a176d8-3eb9-47b1-b799-4c3101c20663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:59.388281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:59.388281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:59.388281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:59.388281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:59.388281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:59.388281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:59.388281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:59.388281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:59.388281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:59.388281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:59.388281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:59.388281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:12:59.388281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:12:59.388281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:12:59.388281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:12:59.389354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:59.389354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:59.389354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:59.389354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:59.389354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:59.389354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:59.389354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:59.389354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:59.389354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:59.389354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:59.389354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:59.389354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:59.389354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:59.389354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:59.389354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:59.389354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:59.389354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:12:59.390259 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:12:59.390259 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:12:59.390259 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:59.390259 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 547/1102] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:59.395110 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c4387-9e08-43ba-afd8-8a74b9b8a54a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:59.494756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c4387-9e08-43ba-afd8-8a74b9b8a54a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:59.530512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f7f82-39fc-4607-ae96-df152c7f265f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:59.531185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f7f82-39fc-4607-ae96-df152c7f265f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.531514 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f7f82-39fc-4607-ae96-df152c7f265f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.531844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f7f82-39fc-4607-ae96-df152c7f265f None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.532539 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f7f82-39fc-4607-ae96-df152c7f265f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:59.532995 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f7f82-39fc-4607-ae96-df152c7f265f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:59.534419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f7f82-39fc-4607-ae96-df152c7f265f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:59.546776 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 556/1103] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:12:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:59.552354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a176d8-3eb9-47b1-b799-4c3101c20663 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:59.637616 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:59.654848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a176d8-3eb9-47b1-b799-4c3101c20663 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:59.687983 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd375a2-96fe-455a-b2b7-4d3885210182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:59.688615 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd375a2-96fe-455a-b2b7-4d3885210182 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.688892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd375a2-96fe-455a-b2b7-4d3885210182 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.689155 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd375a2-96fe-455a-b2b7-4d3885210182 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.696158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd375a2-96fe-455a-b2b7-4d3885210182 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:59.697657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd375a2-96fe-455a-b2b7-4d3885210182 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:59.708636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8fd375a2-96fe-455a-b2b7-4d3885210182 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:59.708636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:12:59.708636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:12:59.708636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:12:59.708636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:12:59.708636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:12:59.708636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:12:59.708636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:12:59.708636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:12:59.708636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:12:59.708636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:12:59.708636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:12:59.708636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:12:59.708636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:12:59.708636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:12:59.709548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:12:59.709548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:12:59.709548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:12:59.709548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:12:59.709548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:12:59.709548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:12:59.709548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:12:59.709548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:12:59.709548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:12:59.709548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:12:59.709548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:12:59.709548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:12:59.709548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:12:59.709548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:12:59.709548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:12:59.709548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:12:59.709548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:12:59.711680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:12:59.711680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:12:59.711680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:12:59.711680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:12:59.711680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:12:59.711680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:12:59.711680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:12:59.711680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:12:59.711680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 548/1104] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:12:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:12:59.716150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f7f82-39fc-4607-ae96-df152c7f265f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:59.761281 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:59.820003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f7f82-39fc-4607-ae96-df152c7f265f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:59.856724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1182c-8064-4a66-9ace-5ec822b9358f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:59.857332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1182c-8064-4a66-9ace-5ec822b9358f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.857610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1182c-8064-4a66-9ace-5ec822b9358f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.857883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1182c-8064-4a66-9ace-5ec822b9358f None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.858604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1182c-8064-4a66-9ace-5ec822b9358f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:12:59.858885 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1182c-8064-4a66-9ace-5ec822b9358f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:59.860313 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1182c-8064-4a66-9ace-5ec822b9358f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:59.873397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 557/1105] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:12:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:12:59.879448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd375a2-96fe-455a-b2b7-4d3885210182 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:59.972273 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1afba-1d00-41ec-90a9-7af9bb1e68bc None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.972552 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1afba-1d00-41ec-90a9-7af9bb1e68bc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.972850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1afba-1d00-41ec-90a9-7af9bb1e68bc None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.974181 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 558/1106] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:12:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:12:59.979982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b70e6e-9f93-4558-b5bd-829a9c5949b3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:59.980264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b70e6e-9f93-4558-b5bd-829a9c5949b3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:59.980538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b70e6e-9f93-4558-b5bd-829a9c5949b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:59.987474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd375a2-96fe-455a-b2b7-4d3885210182 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:00.000798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-15b70e6e-9f93-4558-b5bd-829a9c5949b3 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:00.002010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-15b70e6e-9f93-4558-b5bd-829a9c5949b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:00.021673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c516dcc-ad13-4a46-ab26-077b454f8ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:00.023129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c516dcc-ad13-4a46-ab26-077b454f8ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:00.023129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c516dcc-ad13-4a46-ab26-077b454f8ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:00.023387 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c516dcc-ad13-4a46-ab26-077b454f8ef3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.023990 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c516dcc-ad13-4a46-ab26-077b454f8ef3 None admin] RBAC: Adding query filter params (role.id=66e20b7ea4884a8891f2561c6efe905f, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=2f985626d8af4f3089e72998fad98b47) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:00.024298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c516dcc-ad13-4a46-ab26-077b454f8ef3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:00.025760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c516dcc-ad13-4a46-ab26-077b454f8ef3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:00.031720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 549/1107] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:12:59 2022] GET /identity/v3/role_assignments?user.id=2f985626d8af4f3089e72998fad98b47&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=66e20b7ea4884a8891f2561c6efe905f => generated 610 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:00.075496 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 559/1108] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:12:59 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:13:00.346263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c516dcc-ad13-4a46-ab26-077b454f8ef3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:00.358110 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:00.464941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c516dcc-ad13-4a46-ab26-077b454f8ef3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:00.500051 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0f5c2-3351-4f21-80f3-4b11f690aa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:00.500715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0f5c2-3351-4f21-80f3-4b11f690aa13 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:00.500992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0f5c2-3351-4f21-80f3-4b11f690aa13 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:00.501264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0f5c2-3351-4f21-80f3-4b11f690aa13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.502393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0f5c2-3351-4f21-80f3-4b11f690aa13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:00.503822 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0f5c2-3351-4f21-80f3-4b11f690aa13 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:00.505428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 550/1109] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:13:00 2022] GET /identity/v3/domains/default => generated 200 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:00.512149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b70e6e-9f93-4558-b5bd-829a9c5949b3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:00.545329 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:00.619040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b70e6e-9f93-4558-b5bd-829a9c5949b3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:00.654208 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d8484-84ff-4ca2-8779-628d64c97c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:00.654827 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d8484-84ff-4ca2-8779-628d64c97c16 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:00.655104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d8484-84ff-4ca2-8779-628d64c97c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:00.655373 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d8484-84ff-4ca2-8779-628d64c97c16 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.656030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d8484-84ff-4ca2-8779-628d64c97c16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:00.657502 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d8484-84ff-4ca2-8779-628d64c97c16 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:00.681204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 560/1110] 10.222.0.107 () {60 vars in 1137 bytes} [Tue Aug 23 23:13:00 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:13:02.673673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55969c2-835a-4301-b1ff-10f72be8ff27 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:02.674228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55969c2-835a-4301-b1ff-10f72be8ff27 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:02.674228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55969c2-835a-4301-b1ff-10f72be8ff27 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:02.675554 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 551/1111] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:13:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:13:02.681608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828fcaf-773f-4aae-bc4b-a547e9be2944 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:02.682089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828fcaf-773f-4aae-bc4b-a547e9be2944 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:02.682190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828fcaf-773f-4aae-bc4b-a547e9be2944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:02.700704 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1828fcaf-773f-4aae-bc4b-a547e9be2944 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:02.701894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1828fcaf-773f-4aae-bc4b-a547e9be2944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:02.767284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 561/1112] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:13:02 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:03.035592 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55969c2-835a-4301-b1ff-10f72be8ff27 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:03.117632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:03.141208 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55969c2-835a-4301-b1ff-10f72be8ff27 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:03.173603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02e7e7-d8d3-4956-a918-9cccd9cbe123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:03.174216 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02e7e7-d8d3-4956-a918-9cccd9cbe123 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:03.174490 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02e7e7-d8d3-4956-a918-9cccd9cbe123 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:03.174760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02e7e7-d8d3-4956-a918-9cccd9cbe123 None admin] PATH_INFO: `/v3/roles/8801d305c8374d34abe896d3b7685174` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:03.176127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02e7e7-d8d3-4956-a918-9cccd9cbe123 None admin] RBAC: Authorizing `identity:get_role(role_id=8801d305c8374d34abe896d3b7685174)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:03.177515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02e7e7-d8d3-4956-a918-9cccd9cbe123 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:03.179528 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 552/1113] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:13:03 2022] GET /identity/v3/roles/8801d305c8374d34abe896d3b7685174 => generated 224 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:03.185509 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828fcaf-773f-4aae-bc4b-a547e9be2944 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:03.203889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:03.285013 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828fcaf-773f-4aae-bc4b-a547e9be2944 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:03.320215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c3e99-e199-4beb-a367-fdcd433f2683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:03.320869 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c3e99-e199-4beb-a367-fdcd433f2683 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:03.321147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c3e99-e199-4beb-a367-fdcd433f2683 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:03.321415 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c3e99-e199-4beb-a367-fdcd433f2683 None admin] PATH_INFO: `/v3/users/cf10c07338d047dd8db8097684017ab7` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:03.334304 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c3e99-e199-4beb-a367-fdcd433f2683 None admin] RBAC: Authorizing `identity:get_user(user_id=cf10c07338d047dd8db8097684017ab7)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:03.335782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c3e99-e199-4beb-a367-fdcd433f2683 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:03.337443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 562/1114] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:13:03 2022] GET /identity/v3/users/cf10c07338d047dd8db8097684017ab7 => generated 287 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:03.343264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02e7e7-d8d3-4956-a918-9cccd9cbe123 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:03.441430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02e7e7-d8d3-4956-a918-9cccd9cbe123 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:03.473137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfccd0-700e-40ed-80a0-d901f7e88d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:03.473719 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfccd0-700e-40ed-80a0-d901f7e88d6a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:03.473992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfccd0-700e-40ed-80a0-d901f7e88d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:03.474259 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfccd0-700e-40ed-80a0-d901f7e88d6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:03.489738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:03.543144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfccd0-700e-40ed-80a0-d901f7e88d6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:03.544500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfccd0-700e-40ed-80a0-d901f7e88d6a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:03.640779 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 553/1115] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:13:03 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:13:03.646774 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c3e99-e199-4beb-a367-fdcd433f2683 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:03.724350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:03.747775 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c3e99-e199-4beb-a367-fdcd433f2683 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:03.780946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfae463-eb23-486f-8bb4-16167b511f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:03.781562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfae463-eb23-486f-8bb4-16167b511f0e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:03.781834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfae463-eb23-486f-8bb4-16167b511f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:03.782102 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfae463-eb23-486f-8bb4-16167b511f0e None admin] PATH_INFO: `/v3/projects/35655c5fce364e638e5e32e05131c3f7` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:03.783201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfae463-eb23-486f-8bb4-16167b511f0e None admin] RBAC: Authorizing `identity:get_project(project_id=35655c5fce364e638e5e32e05131c3f7)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:03.784629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfae463-eb23-486f-8bb4-16167b511f0e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:03.786220 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 563/1116] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:13:03 2022] GET /identity/v3/projects/35655c5fce364e638e5e32e05131c3f7 => generated 312 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:03.793989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfccd0-700e-40ed-80a0-d901f7e88d6a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:03.839322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:03.892424 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfccd0-700e-40ed-80a0-d901f7e88d6a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:03.927428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edf2db-2d2f-47b9-9edf-d272107b77e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:03.928024 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edf2db-2d2f-47b9-9edf-d272107b77e8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:03.928302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edf2db-2d2f-47b9-9edf-d272107b77e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:03.928572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edf2db-2d2f-47b9-9edf-d272107b77e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:03.929345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edf2db-2d2f-47b9-9edf-d272107b77e8 None admin] RBAC: Adding query filter params (role.id=8801d305c8374d34abe896d3b7685174, scope.project.id=35655c5fce364e638e5e32e05131c3f7, user.id=cf10c07338d047dd8db8097684017ab7) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:03.929647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edf2db-2d2f-47b9-9edf-d272107b77e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:03.931083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edf2db-2d2f-47b9-9edf-d272107b77e8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:03.937596 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 554/1117] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:13:03 2022] GET /identity/v3/role_assignments?user.id=cf10c07338d047dd8db8097684017ab7&scope.project.id=35655c5fce364e638e5e32e05131c3f7&role.id=8801d305c8374d34abe896d3b7685174 => generated 260 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:05.820543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779e11b-60f3-4e79-997d-fb1c1c82c962 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:05.821133 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779e11b-60f3-4e79-997d-fb1c1c82c962 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:05.821133 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779e11b-60f3-4e79-997d-fb1c1c82c962 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:05.822461 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 564/1118] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:13:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:13:05.827793 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48800a-b910-42d3-8cca-0d178fad3cab None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:05.828374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48800a-b910-42d3-8cca-0d178fad3cab None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:05.828690 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48800a-b910-42d3-8cca-0d178fad3cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:05.847086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ee48800a-b910-42d3-8cca-0d178fad3cab None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:05.848296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ee48800a-b910-42d3-8cca-0d178fad3cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:05.916844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 555/1119] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:13:05 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:06.181567 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779e11b-60f3-4e79-997d-fb1c1c82c962 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:06.281571 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779e11b-60f3-4e79-997d-fb1c1c82c962 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:06.315975 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836143a-5407-41da-af49-b3355500adb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:06.316587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836143a-5407-41da-af49-b3355500adb2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:06.316896 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836143a-5407-41da-af49-b3355500adb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:06.317164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836143a-5407-41da-af49-b3355500adb2 None admin] PATH_INFO: `/v3/roles/8801d305c8374d34abe896d3b7685174` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:06.318547 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836143a-5407-41da-af49-b3355500adb2 None admin] RBAC: Authorizing `identity:get_role(role_id=8801d305c8374d34abe896d3b7685174)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:06.320471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836143a-5407-41da-af49-b3355500adb2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:06.321845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 565/1120] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:13:06 2022] GET /identity/v3/roles/8801d305c8374d34abe896d3b7685174 => generated 224 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:06.327711 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48800a-b910-42d3-8cca-0d178fad3cab None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:06.366639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:06.425802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48800a-b910-42d3-8cca-0d178fad3cab None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:06.458957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823cdd9-d382-44f0-95ff-f3707deca831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:06.459571 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823cdd9-d382-44f0-95ff-f3707deca831 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:06.459849 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823cdd9-d382-44f0-95ff-f3707deca831 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:06.460706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823cdd9-d382-44f0-95ff-f3707deca831 None admin] PATH_INFO: `/v3/users/cf10c07338d047dd8db8097684017ab7` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:06.461830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823cdd9-d382-44f0-95ff-f3707deca831 None admin] RBAC: Authorizing `identity:get_user(user_id=cf10c07338d047dd8db8097684017ab7)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:06.463258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823cdd9-d382-44f0-95ff-f3707deca831 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:06.464874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 556/1121] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:13:06 2022] GET /identity/v3/users/cf10c07338d047dd8db8097684017ab7 => generated 287 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:06.470711 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836143a-5407-41da-af49-b3355500adb2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:06.485591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:06.581459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836143a-5407-41da-af49-b3355500adb2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:06.615314 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360a818-861a-4827-8c53-7a2b8c9e2833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:06.615943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360a818-861a-4827-8c53-7a2b8c9e2833 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:06.616248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360a818-861a-4827-8c53-7a2b8c9e2833 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:06.616521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360a818-861a-4827-8c53-7a2b8c9e2833 None admin] PATH_INFO: `/v3/projects/35655c5fce364e638e5e32e05131c3f7` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:06.617687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360a818-861a-4827-8c53-7a2b8c9e2833 None admin] RBAC: Authorizing `identity:get_project(project_id=35655c5fce364e638e5e32e05131c3f7)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:06.619112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360a818-861a-4827-8c53-7a2b8c9e2833 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:06.620763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 566/1122] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:13:06 2022] GET /identity/v3/projects/35655c5fce364e638e5e32e05131c3f7 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:06.626744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823cdd9-d382-44f0-95ff-f3707deca831 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:06.725462 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823cdd9-d382-44f0-95ff-f3707deca831 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:06.732678 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:06.761457 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981761a4-a2c9-4b79-bd3b-b7b9efa8092a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:06.762108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981761a4-a2c9-4b79-bd3b-b7b9efa8092a None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:06.762388 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981761a4-a2c9-4b79-bd3b-b7b9efa8092a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:06.762664 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981761a4-a2c9-4b79-bd3b-b7b9efa8092a None admin] PATH_INFO: `/v3/projects/35655c5fce364e638e5e32e05131c3f7/users/cf10c07338d047dd8db8097684017ab7/roles/8801d305c8374d34abe896d3b7685174` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:06.764814 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981761a4-a2c9-4b79-bd3b-b7b9efa8092a None admin] RBAC: Authorizing `identity:create_grant(project_id=35655c5fce364e638e5e32e05131c3f7, user_id=cf10c07338d047dd8db8097684017ab7, role_id=8801d305c8374d34abe896d3b7685174)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:06.766242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981761a4-a2c9-4b79-bd3b-b7b9efa8092a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:06.778626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 557/1123] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:13:06 2022] PUT /identity/v3/projects/35655c5fce364e638e5e32e05131c3f7/users/cf10c07338d047dd8db8097684017ab7/roles/8801d305c8374d34abe896d3b7685174 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:13:08.698443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf59941-b9b9-48fa-9a34-8b75764ec839 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:08.698985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf59941-b9b9-48fa-9a34-8b75764ec839 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:08.698985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf59941-b9b9-48fa-9a34-8b75764ec839 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:08.700300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 567/1124] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:13:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:13:08.705780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb714b-9702-4c61-8551-0eef2b7cfe73 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:08.706204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb714b-9702-4c61-8551-0eef2b7cfe73 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:08.706305 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb714b-9702-4c61-8551-0eef2b7cfe73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:08.724553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8fbb714b-9702-4c61-8551-0eef2b7cfe73 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:08.726420 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8fbb714b-9702-4c61-8551-0eef2b7cfe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:08.792983 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 558/1125] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:13:08 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:09.063943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf59941-b9b9-48fa-9a34-8b75764ec839 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:09.144987 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:09.166102 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf59941-b9b9-48fa-9a34-8b75764ec839 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:09.200093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087527c-c8b6-413d-9b80-8dd279957c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:09.200734 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087527c-c8b6-413d-9b80-8dd279957c3a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:09.201015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087527c-c8b6-413d-9b80-8dd279957c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:09.201288 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087527c-c8b6-413d-9b80-8dd279957c3a None admin] PATH_INFO: `/v3/roles/8801d305c8374d34abe896d3b7685174` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:09.202679 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087527c-c8b6-413d-9b80-8dd279957c3a None admin] RBAC: Authorizing `identity:get_role(role_id=8801d305c8374d34abe896d3b7685174)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:09.204045 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087527c-c8b6-413d-9b80-8dd279957c3a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:09.205553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 568/1126] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:13:09 2022] GET /identity/v3/roles/8801d305c8374d34abe896d3b7685174 => generated 224 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:09.212344 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb714b-9702-4c61-8551-0eef2b7cfe73 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:09.311215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:09.317483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb714b-9702-4c61-8551-0eef2b7cfe73 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:09.353389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1419c-b144-4280-8600-0f67492039b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:09.354011 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1419c-b144-4280-8600-0f67492039b9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:09.354291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1419c-b144-4280-8600-0f67492039b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:09.354557 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1419c-b144-4280-8600-0f67492039b9 None admin] PATH_INFO: `/v3/users/cf10c07338d047dd8db8097684017ab7` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:09.355662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1419c-b144-4280-8600-0f67492039b9 None admin] RBAC: Authorizing `identity:get_user(user_id=cf10c07338d047dd8db8097684017ab7)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:09.357120 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1419c-b144-4280-8600-0f67492039b9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:09.358690 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 559/1127] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:13:09 2022] GET /identity/v3/users/cf10c07338d047dd8db8097684017ab7 => generated 287 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:13:09.364474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087527c-c8b6-413d-9b80-8dd279957c3a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:09.461459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087527c-c8b6-413d-9b80-8dd279957c3a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:09.495573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d5b4a-f9e3-4b2b-bcb2-28c8be77e258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:09.496170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d5b4a-f9e3-4b2b-bcb2-28c8be77e258 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:09.496446 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d5b4a-f9e3-4b2b-bcb2-28c8be77e258 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:09.496748 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d5b4a-f9e3-4b2b-bcb2-28c8be77e258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:09.513763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:09.563099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d5b4a-f9e3-4b2b-bcb2-28c8be77e258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:09.564460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d5b4a-f9e3-4b2b-bcb2-28c8be77e258 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:09.659706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 569/1128] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:13:09 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:13:09.665907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1419c-b144-4280-8600-0f67492039b9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:09.763664 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1419c-b144-4280-8600-0f67492039b9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:09.797283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932b73b-cd06-4494-a136-9d15d128aea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:09.797905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932b73b-cd06-4494-a136-9d15d128aea6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:09.798179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932b73b-cd06-4494-a136-9d15d128aea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:09.798449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932b73b-cd06-4494-a136-9d15d128aea6 None admin] PATH_INFO: `/v3/projects/35655c5fce364e638e5e32e05131c3f7` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:09.799559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932b73b-cd06-4494-a136-9d15d128aea6 None admin] RBAC: Authorizing `identity:get_project(project_id=35655c5fce364e638e5e32e05131c3f7)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:09.801073 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932b73b-cd06-4494-a136-9d15d128aea6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:09.802643 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 560/1129] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:13:09 2022] GET /identity/v3/projects/35655c5fce364e638e5e32e05131c3f7 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:09.809520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d5b4a-f9e3-4b2b-bcb2-28c8be77e258 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:09.858274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:09.909729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d5b4a-f9e3-4b2b-bcb2-28c8be77e258 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:09.943843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce8159-d156-4713-8406-ab3e27e9a803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:09.944587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce8159-d156-4713-8406-ab3e27e9a803 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:09.944899 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce8159-d156-4713-8406-ab3e27e9a803 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:09.945171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce8159-d156-4713-8406-ab3e27e9a803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:09.945896 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce8159-d156-4713-8406-ab3e27e9a803 None admin] RBAC: Adding query filter params (role.id=8801d305c8374d34abe896d3b7685174, scope.project.id=35655c5fce364e638e5e32e05131c3f7, user.id=cf10c07338d047dd8db8097684017ab7) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:09.946203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce8159-d156-4713-8406-ab3e27e9a803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:09.947632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce8159-d156-4713-8406-ab3e27e9a803 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:09.953562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 570/1130] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:13:09 2022] GET /identity/v3/role_assignments?user.id=cf10c07338d047dd8db8097684017ab7&scope.project.id=35655c5fce364e638e5e32e05131c3f7&role.id=8801d305c8374d34abe896d3b7685174 => generated 610 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:12.003944 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f4811-5c3f-46a0-9b2c-a4a5394e50c5 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:12.004418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f4811-5c3f-46a0-9b2c-a4a5394e50c5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:12.004505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f4811-5c3f-46a0-9b2c-a4a5394e50c5 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:12.005854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 561/1131] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:13:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:13:12.013441 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07abaca-845d-4743-b343-dc8bb72c5a70 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:12.013847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07abaca-845d-4743-b343-dc8bb72c5a70 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:12.014086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07abaca-845d-4743-b343-dc8bb72c5a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:12.033394 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b07abaca-845d-4743-b343-dc8bb72c5a70 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:12.034579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b07abaca-845d-4743-b343-dc8bb72c5a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:12.104149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 571/1132] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:13:12 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:12.388573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f4811-5c3f-46a0-9b2c-a4a5394e50c5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:12.421716 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:12.495986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f4811-5c3f-46a0-9b2c-a4a5394e50c5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:12.528921 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96deed48-135e-43dc-a867-d0eca9998fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:12.529539 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deed48-135e-43dc-a867-d0eca9998fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:12.529815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deed48-135e-43dc-a867-d0eca9998fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:12.530092 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deed48-135e-43dc-a867-d0eca9998fd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:12.531200 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96deed48-135e-43dc-a867-d0eca9998fd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:12.532654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96deed48-135e-43dc-a867-d0eca9998fd2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:12.534204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 562/1133] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:13:12 2022] GET /identity/v3/domains/default => generated 200 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:12.540963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07abaca-845d-4743-b343-dc8bb72c5a70 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:12.583156 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:12.655347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07abaca-845d-4743-b343-dc8bb72c5a70 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:12.689076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b656c-8b5f-4b3f-94f3-116f0ebb5c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:12.689679 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b656c-8b5f-4b3f-94f3-116f0ebb5c1a None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:12.689957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b656c-8b5f-4b3f-94f3-116f0ebb5c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:12.690230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b656c-8b5f-4b3f-94f3-116f0ebb5c1a None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:12.690870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b656c-8b5f-4b3f-94f3-116f0ebb5c1a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:12.692299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b656c-8b5f-4b3f-94f3-116f0ebb5c1a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:12.719323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 572/1134] 10.222.0.107 () {60 vars in 1146 bytes} [Tue Aug 23 23:13:12 2022] POST /identity/v3/projects => generated 312 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:13:14.646095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b84fed-7869-49cb-9070-e5099937724f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:14.646635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b84fed-7869-49cb-9070-e5099937724f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:14.646635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b84fed-7869-49cb-9070-e5099937724f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:14.648373 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 563/1135] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:13:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:13:14.654063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78922ac6-f03c-41fa-b4b2-d711a0731819 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:14.654559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78922ac6-f03c-41fa-b4b2-d711a0731819 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:14.654654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78922ac6-f03c-41fa-b4b2-d711a0731819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:14.674295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-78922ac6-f03c-41fa-b4b2-d711a0731819 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:14.675496 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-78922ac6-f03c-41fa-b4b2-d711a0731819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:14.745034 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 573/1136] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:13:14 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:15.017039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b84fed-7869-49cb-9070-e5099937724f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:15.125941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:15.132126 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b84fed-7869-49cb-9070-e5099937724f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:15.168924 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65517e8d-277d-4883-bd02-8fb665616bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:15.169559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65517e8d-277d-4883-bd02-8fb665616bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:15.169836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65517e8d-277d-4883-bd02-8fb665616bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:15.170115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65517e8d-277d-4883-bd02-8fb665616bf0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:15.171591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65517e8d-277d-4883-bd02-8fb665616bf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:15.173085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65517e8d-277d-4883-bd02-8fb665616bf0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:15.174709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 564/1137] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:13:15 2022] GET /identity/v3/domains/default => generated 200 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:15.181185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78922ac6-f03c-41fa-b4b2-d711a0731819 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:15.209324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:15.310400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78922ac6-f03c-41fa-b4b2-d711a0731819 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:15.370785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe613c8-6278-4f89-b19f-245836b0ca12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:15.371396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe613c8-6278-4f89-b19f-245836b0ca12 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:15.371666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe613c8-6278-4f89-b19f-245836b0ca12 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:15.371930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe613c8-6278-4f89-b19f-245836b0ca12 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:15.372584 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe613c8-6278-4f89-b19f-245836b0ca12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:15.378754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe613c8-6278-4f89-b19f-245836b0ca12 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:15.407874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 574/1138] 10.222.0.107 () {60 vars in 1137 bytes} [Tue Aug 23 23:13:15 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:13:17.476398 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99afeb-4943-4c07-bac6-4ed95ee6cac4 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:17.476970 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99afeb-4943-4c07-bac6-4ed95ee6cac4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:17.476970 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99afeb-4943-4c07-bac6-4ed95ee6cac4 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:17.478235 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 565/1139] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:13:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:13:17.485222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f55ac-82ad-4ecd-b4dd-0c79070ff47e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:17.485732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f55ac-82ad-4ecd-b4dd-0c79070ff47e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:17.485989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f55ac-82ad-4ecd-b4dd-0c79070ff47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:17.504958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-775f55ac-82ad-4ecd-b4dd-0c79070ff47e None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:17.506186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-775f55ac-82ad-4ecd-b4dd-0c79070ff47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:17.587280 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 575/1140] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:13:17 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:13:17.868310 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99afeb-4943-4c07-bac6-4ed95ee6cac4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:17.984143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99afeb-4943-4c07-bac6-4ed95ee6cac4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:18.023992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d05b6-ced3-4002-8af4-9f369a0daa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:18.024671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d05b6-ced3-4002-8af4-9f369a0daa19 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:18.024957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d05b6-ced3-4002-8af4-9f369a0daa19 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:18.025229 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d05b6-ced3-4002-8af4-9f369a0daa19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:18.036664 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d05b6-ced3-4002-8af4-9f369a0daa19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:13:18.043083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4b7d05b6-ced3-4002-8af4-9f369a0daa19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:13:18.043083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:18.043083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:18.043083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:18.043083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:18.043083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:18.043083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:18.043083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:18.043083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:18.043083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:18.043083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:18.043083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:18.043083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:13:18.043083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:13:18.043083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:13:18.043083 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:13:18.044261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:13:18.044261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:13:18.044261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:13:18.044261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:13:18.044261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:18.044261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:18.044261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:18.044261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:18.044261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:18.044261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:18.044261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:18.044261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:18.044261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:18.044261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:18.044261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:18.044261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:18.045334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:18.045334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:18.045334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:18.045334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:18.045334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:13:18.045334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:13:18.045334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:13:18.045334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:13:18.045334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:13:18.045334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:13:18.045334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:13:18.045334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:13:18.045334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 566/1141] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:13:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:18.053105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f55ac-82ad-4ecd-b4dd-0c79070ff47e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:18.067666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:18.175893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f55ac-82ad-4ecd-b4dd-0c79070ff47e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:18.212304 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657acc2-58b2-431b-a8d3-ae4732d623ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:18.212941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657acc2-58b2-431b-a8d3-ae4732d623ea None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:18.213213 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657acc2-58b2-431b-a8d3-ae4732d623ea None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:18.213476 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657acc2-58b2-431b-a8d3-ae4732d623ea None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:18.214140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657acc2-58b2-431b-a8d3-ae4732d623ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:18.214437 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657acc2-58b2-431b-a8d3-ae4732d623ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:18.215801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657acc2-58b2-431b-a8d3-ae4732d623ea None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:18.225011 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 576/1142] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:13:18 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:18.231518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d05b6-ced3-4002-8af4-9f369a0daa19 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:18.272062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:18.354295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d05b6-ced3-4002-8af4-9f369a0daa19 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:18.391694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871f388-8bb0-4dfd-88a5-e8190a1b5b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:18.392410 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871f388-8bb0-4dfd-88a5-e8190a1b5b81 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:18.392800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871f388-8bb0-4dfd-88a5-e8190a1b5b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:18.393072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871f388-8bb0-4dfd-88a5-e8190a1b5b81 None admin] PATH_INFO: `/v3/users/6f62e67a768340cc87000ce45bfb30fa` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:18.411325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871f388-8bb0-4dfd-88a5-e8190a1b5b81 None admin] RBAC: Authorizing `identity:get_user(user_id=6f62e67a768340cc87000ce45bfb30fa)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:18.412807 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871f388-8bb0-4dfd-88a5-e8190a1b5b81 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:18.416211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 567/1143] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:13:18 2022] GET /identity/v3/users/6f62e67a768340cc87000ce45bfb30fa => generated 287 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:18.424998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657acc2-58b2-431b-a8d3-ae4732d623ea None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:18.510553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:18.542952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657acc2-58b2-431b-a8d3-ae4732d623ea None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:18.578910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298fc68-1a39-4b76-9d25-21b06170cbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:18.579524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298fc68-1a39-4b76-9d25-21b06170cbc4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:18.579791 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298fc68-1a39-4b76-9d25-21b06170cbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:18.580052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298fc68-1a39-4b76-9d25-21b06170cbc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:18.653095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298fc68-1a39-4b76-9d25-21b06170cbc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:18.654810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298fc68-1a39-4b76-9d25-21b06170cbc4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:18.749604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:18.792047 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 577/1144] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:13:18 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 23:13:18.798198 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871f388-8bb0-4dfd-88a5-e8190a1b5b81 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:18.893018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:18.909497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871f388-8bb0-4dfd-88a5-e8190a1b5b81 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:18.957213 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f7cc4-fd62-4875-848b-8d0b8da8e53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:18.957839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f7cc4-fd62-4875-848b-8d0b8da8e53d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:18.958126 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f7cc4-fd62-4875-848b-8d0b8da8e53d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:18.958385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f7cc4-fd62-4875-848b-8d0b8da8e53d None admin] PATH_INFO: `/v3/projects/f7b506561a134159af7fc2b25c5807b8` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:18.959503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f7cc4-fd62-4875-848b-8d0b8da8e53d None admin] RBAC: Authorizing `identity:get_project(project_id=f7b506561a134159af7fc2b25c5807b8)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:18.961206 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f7cc4-fd62-4875-848b-8d0b8da8e53d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:18.962844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 568/1145] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:13:18 2022] GET /identity/v3/projects/f7b506561a134159af7fc2b25c5807b8 => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:18.969571 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298fc68-1a39-4b76-9d25-21b06170cbc4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:19.077459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298fc68-1a39-4b76-9d25-21b06170cbc4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:19.120618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59feede6-5f5a-41f7-b6db-456f52376274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:19.121244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59feede6-5f5a-41f7-b6db-456f52376274 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:19.121521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59feede6-5f5a-41f7-b6db-456f52376274 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:19.121790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59feede6-5f5a-41f7-b6db-456f52376274 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:19.122521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59feede6-5f5a-41f7-b6db-456f52376274 None admin] RBAC: Adding query filter params (role.id=97ece22f2e264e0e857d5107325a85d9, scope.project.id=f7b506561a134159af7fc2b25c5807b8, user.id=6f62e67a768340cc87000ce45bfb30fa) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:19.122828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59feede6-5f5a-41f7-b6db-456f52376274 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:19.124248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59feede6-5f5a-41f7-b6db-456f52376274 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:19.130255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 578/1146] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:13:18 2022] GET /identity/v3/role_assignments?user.id=6f62e67a768340cc87000ce45bfb30fa&scope.project.id=f7b506561a134159af7fc2b25c5807b8&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:21.116096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480988c1-1cae-4e69-b1eb-3f89948c31a6 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:21.117421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480988c1-1cae-4e69-b1eb-3f89948c31a6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:21.117421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480988c1-1cae-4e69-b1eb-3f89948c31a6 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:21.118539 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 569/1147] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:13:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:13:21.124184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa7a2d-fbb1-4b28-8589-1279224ec06a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:21.124684 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa7a2d-fbb1-4b28-8589-1279224ec06a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:21.124814 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa7a2d-fbb1-4b28-8589-1279224ec06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:21.143983 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-18fa7a2d-fbb1-4b28-8589-1279224ec06a None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:21.145223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-18fa7a2d-fbb1-4b28-8589-1279224ec06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:21.176887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:21.220750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 579/1148] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:13:21 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:21.498633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480988c1-1cae-4e69-b1eb-3f89948c31a6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:21.628915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480988c1-1cae-4e69-b1eb-3f89948c31a6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:21.667192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa2856-f086-433d-ad26-834b653e403f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:21.667832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa2856-f086-433d-ad26-834b653e403f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:21.668107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa2856-f086-433d-ad26-834b653e403f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:21.668378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa2856-f086-433d-ad26-834b653e403f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:21.679657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa2856-f086-433d-ad26-834b653e403f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:13:21.685408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-07aa2856-f086-433d-ad26-834b653e403f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:13:21.685408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:21.685408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:21.685408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:21.685408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:21.685408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:21.685408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:21.685408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:21.685408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:21.685408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:21.685408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:21.685408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:21.685408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:13:21.685408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:13:21.685408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:13:21.685408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:13:21.687028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:13:21.687028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:13:21.687028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:13:21.687028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:13:21.687028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:21.687028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:21.687028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:21.687028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:21.687028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:21.687028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:21.687028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:21.687028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:21.687028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:21.687028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:21.687028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:21.687028 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:21.687966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:21.687966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:21.687966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:21.687966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:21.687966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:13:21.687966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:13:21.687966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:13:21.687966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:13:21.687966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:13:21.687966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:13:21.687966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:13:21.687966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:13:21.687966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 570/1149] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:13:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:21.692762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa7a2d-fbb1-4b28-8589-1279224ec06a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:21.807576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa7a2d-fbb1-4b28-8589-1279224ec06a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:21.844148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800dd61-f265-4bfe-994b-109f14478fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:21.844782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800dd61-f265-4bfe-994b-109f14478fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:21.845059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800dd61-f265-4bfe-994b-109f14478fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:21.845331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800dd61-f265-4bfe-994b-109f14478fb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:21.846003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800dd61-f265-4bfe-994b-109f14478fb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:21.846302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800dd61-f265-4bfe-994b-109f14478fb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:21.847668 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800dd61-f265-4bfe-994b-109f14478fb2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:21.857263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 580/1150] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:13:21 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:21.863843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa2856-f086-433d-ad26-834b653e403f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:21.881354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:21.993562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa2856-f086-433d-ad26-834b653e403f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:22.039125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb449e-8d24-46af-bf88-c7b45caad133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:22.040690 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb449e-8d24-46af-bf88-c7b45caad133 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:22.041145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb449e-8d24-46af-bf88-c7b45caad133 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:22.041591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb449e-8d24-46af-bf88-c7b45caad133 None admin] PATH_INFO: `/v3/users/6f62e67a768340cc87000ce45bfb30fa` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:22.043392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb449e-8d24-46af-bf88-c7b45caad133 None admin] RBAC: Authorizing `identity:get_user(user_id=6f62e67a768340cc87000ce45bfb30fa)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:22.044867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb449e-8d24-46af-bf88-c7b45caad133 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:22.046744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 571/1151] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:13:21 2022] GET /identity/v3/users/6f62e67a768340cc87000ce45bfb30fa => generated 287 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:22.052613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800dd61-f265-4bfe-994b-109f14478fb2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:22.083692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:22.160225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800dd61-f265-4bfe-994b-109f14478fb2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:22.198138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fe013-d1a6-4853-85ab-b627503fb3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:22.198772 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fe013-d1a6-4853-85ab-b627503fb3de None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:22.199045 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fe013-d1a6-4853-85ab-b627503fb3de None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:22.199309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fe013-d1a6-4853-85ab-b627503fb3de None admin] PATH_INFO: `/v3/projects/f7b506561a134159af7fc2b25c5807b8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:22.200427 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225fe013-d1a6-4853-85ab-b627503fb3de None admin] RBAC: Authorizing `identity:get_project(project_id=f7b506561a134159af7fc2b25c5807b8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:22.201872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225fe013-d1a6-4853-85ab-b627503fb3de None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:22.203525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 581/1152] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:13:22 2022] GET /identity/v3/projects/f7b506561a134159af7fc2b25c5807b8 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:22.209692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb449e-8d24-46af-bf88-c7b45caad133 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:22.304896 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:22.329596 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb449e-8d24-46af-bf88-c7b45caad133 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:22.385942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c508e-120d-425e-9913-483e32f187dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:22.386526 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c508e-120d-425e-9913-483e32f187dc None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:22.386803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c508e-120d-425e-9913-483e32f187dc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:22.387076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c508e-120d-425e-9913-483e32f187dc None admin] PATH_INFO: `/v3/projects/f7b506561a134159af7fc2b25c5807b8/users/6f62e67a768340cc87000ce45bfb30fa/roles/97ece22f2e264e0e857d5107325a85d9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:22.389039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c508e-120d-425e-9913-483e32f187dc None admin] RBAC: Authorizing `identity:create_grant(project_id=f7b506561a134159af7fc2b25c5807b8, user_id=6f62e67a768340cc87000ce45bfb30fa, role_id=97ece22f2e264e0e857d5107325a85d9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:22.390474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c508e-120d-425e-9913-483e32f187dc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:22.406622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 572/1153] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:13:22 2022] PUT /identity/v3/projects/f7b506561a134159af7fc2b25c5807b8/users/6f62e67a768340cc87000ce45bfb30fa/roles/97ece22f2e264e0e857d5107325a85d9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:13:24.402675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb78b1-0669-4ec5-8994-b8bb50f862b2 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:24.403176 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb78b1-0669-4ec5-8994-b8bb50f862b2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:24.403176 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb78b1-0669-4ec5-8994-b8bb50f862b2 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:24.404435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 582/1154] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:13:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:13:24.409676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2a50e-c039-4e0d-8055-a499870db7f3 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:24.410110 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2a50e-c039-4e0d-8055-a499870db7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:24.410230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2a50e-c039-4e0d-8055-a499870db7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:24.429512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8fa2a50e-c039-4e0d-8055-a499870db7f3 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:24.430777 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8fa2a50e-c039-4e0d-8055-a499870db7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:24.496170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 573/1155] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:13:24 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:24.766342 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb78b1-0669-4ec5-8994-b8bb50f862b2 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:24.865769 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:24.873556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb78b1-0669-4ec5-8994-b8bb50f862b2 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:24.908318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1966b-073f-490b-95bf-250754a2f81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:24.908965 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1966b-073f-490b-95bf-250754a2f81c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:24.909244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1966b-073f-490b-95bf-250754a2f81c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:24.909516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1966b-073f-490b-95bf-250754a2f81c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:24.923368 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1966b-073f-490b-95bf-250754a2f81c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:13:24.932267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-05c1966b-073f-490b-95bf-250754a2f81c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:13:24.932267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:24.932267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:24.932267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:24.932267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:24.932267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:24.932267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:24.932267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:24.932267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:24.932267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:24.932267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:24.932267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:24.932267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:13:24.932267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:13:24.932267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:13:24.932267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:13:24.934055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:13:24.934055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:13:24.934055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:13:24.934055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:13:24.934055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:24.934055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:24.934055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:24.934055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:24.934055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:24.934055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:24.934055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:24.934055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:24.934055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:24.934055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:24.934055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:24.934055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:24.935647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:24.935647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:24.935647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:24.935647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:24.935647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:13:24.935647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:13:24.935647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:13:24.935647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:13:24.935647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:13:24.935647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:13:24.935647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:13:24.935647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:13:24.935647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 583/1156] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:13:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:24.943012 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2a50e-c039-4e0d-8055-a499870db7f3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:25.017292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:25.054164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2a50e-c039-4e0d-8055-a499870db7f3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:25.090567 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d0a51-21a3-44c5-8784-4e88b6c97f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:25.091171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d0a51-21a3-44c5-8784-4e88b6c97f1f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:25.091439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d0a51-21a3-44c5-8784-4e88b6c97f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:25.091700 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d0a51-21a3-44c5-8784-4e88b6c97f1f None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:25.092362 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d0a51-21a3-44c5-8784-4e88b6c97f1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:25.092685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d0a51-21a3-44c5-8784-4e88b6c97f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:25.094041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d0a51-21a3-44c5-8784-4e88b6c97f1f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:25.102697 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 574/1157] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:13:24 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:25.108629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1966b-073f-490b-95bf-250754a2f81c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:25.213485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1966b-073f-490b-95bf-250754a2f81c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:25.249366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a018b-4908-435c-9f11-c5b9cf27789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:25.250002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a018b-4908-435c-9f11-c5b9cf27789e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:25.250280 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a018b-4908-435c-9f11-c5b9cf27789e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:25.250553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a018b-4908-435c-9f11-c5b9cf27789e None admin] PATH_INFO: `/v3/users/6f62e67a768340cc87000ce45bfb30fa` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:25.251676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a018b-4908-435c-9f11-c5b9cf27789e None admin] RBAC: Authorizing `identity:get_user(user_id=6f62e67a768340cc87000ce45bfb30fa)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:25.253179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a018b-4908-435c-9f11-c5b9cf27789e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:25.254779 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 584/1158] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:13:25 2022] GET /identity/v3/users/6f62e67a768340cc87000ce45bfb30fa => generated 287 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:25.261249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d0a51-21a3-44c5-8784-4e88b6c97f1f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:25.365529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d0a51-21a3-44c5-8784-4e88b6c97f1f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:25.400162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8c265-04c7-456d-bd77-48b2c4a0ace0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:25.400797 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8c265-04c7-456d-bd77-48b2c4a0ace0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:25.401080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8c265-04c7-456d-bd77-48b2c4a0ace0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:25.401354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8c265-04c7-456d-bd77-48b2c4a0ace0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:25.404013 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:25.473217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8c265-04c7-456d-bd77-48b2c4a0ace0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:25.474681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8c265-04c7-456d-bd77-48b2c4a0ace0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:25.575142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 575/1159] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:13:25 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:13:25.581367 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a018b-4908-435c-9f11-c5b9cf27789e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:25.609998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:25.685377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a018b-4908-435c-9f11-c5b9cf27789e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:25.719286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cd578-ea3d-4846-8c87-f04a79567b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:25.719911 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cd578-ea3d-4846-8c87-f04a79567b77 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:25.720189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cd578-ea3d-4846-8c87-f04a79567b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:25.720457 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cd578-ea3d-4846-8c87-f04a79567b77 None admin] PATH_INFO: `/v3/projects/f7b506561a134159af7fc2b25c5807b8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:25.721591 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cd578-ea3d-4846-8c87-f04a79567b77 None admin] RBAC: Authorizing `identity:get_project(project_id=f7b506561a134159af7fc2b25c5807b8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:25.723019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cd578-ea3d-4846-8c87-f04a79567b77 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:25.724688 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 585/1160] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:13:25 2022] GET /identity/v3/projects/f7b506561a134159af7fc2b25c5807b8 => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:25.731685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8c265-04c7-456d-bd77-48b2c4a0ace0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:25.765012 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:25.836304 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8c265-04c7-456d-bd77-48b2c4a0ace0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:25.873058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abfdd8-d571-40cd-9ad5-876a2cf85006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:25.873658 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abfdd8-d571-40cd-9ad5-876a2cf85006 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:25.873933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abfdd8-d571-40cd-9ad5-876a2cf85006 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:25.874202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abfdd8-d571-40cd-9ad5-876a2cf85006 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:25.874937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abfdd8-d571-40cd-9ad5-876a2cf85006 None admin] RBAC: Adding query filter params (role.id=97ece22f2e264e0e857d5107325a85d9, scope.project.id=f7b506561a134159af7fc2b25c5807b8, user.id=6f62e67a768340cc87000ce45bfb30fa) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:25.875242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abfdd8-d571-40cd-9ad5-876a2cf85006 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:25.876707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abfdd8-d571-40cd-9ad5-876a2cf85006 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:25.883360 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 576/1161] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:13:25 2022] GET /identity/v3/role_assignments?user.id=6f62e67a768340cc87000ce45bfb30fa&scope.project.id=f7b506561a134159af7fc2b25c5807b8&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 610 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:27.876326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e5553-6c69-40e5-a666-bd4ebf482430 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:27.876964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e5553-6c69-40e5-a666-bd4ebf482430 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:27.876964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e5553-6c69-40e5-a666-bd4ebf482430 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:27.880106 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 586/1162] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:13:27 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:13:27.886177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d600a99-0177-438c-b860-e62758fd4fc0 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:27.886623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d600a99-0177-438c-b860-e62758fd4fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:27.886746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d600a99-0177-438c-b860-e62758fd4fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:27.904919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5d600a99-0177-438c-b860-e62758fd4fc0 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:27.906097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5d600a99-0177-438c-b860-e62758fd4fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:27.973456 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 577/1163] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:13:27 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:28.246169 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e5553-6c69-40e5-a666-bd4ebf482430 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:28.349260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:28.360197 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e5553-6c69-40e5-a666-bd4ebf482430 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:28.396634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0356d-1721-4187-b556-cfc17136a69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:28.397247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0356d-1721-4187-b556-cfc17136a69b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:28.398232 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0356d-1721-4187-b556-cfc17136a69b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:28.398421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0356d-1721-4187-b556-cfc17136a69b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:28.470705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0356d-1721-4187-b556-cfc17136a69b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:28.472308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0356d-1721-4187-b556-cfc17136a69b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:28.568138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:28.579322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 587/1164] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:13:28 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:13:28.590142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d600a99-0177-438c-b860-e62758fd4fc0 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:28.635305 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:28.723561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d600a99-0177-438c-b860-e62758fd4fc0 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:28.761617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2e84c-c7b9-4c5f-aa09-af451928e162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:28.762258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2e84c-c7b9-4c5f-aa09-af451928e162 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:28.762538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2e84c-c7b9-4c5f-aa09-af451928e162 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:28.762810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2e84c-c7b9-4c5f-aa09-af451928e162 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:28.770328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2e84c-c7b9-4c5f-aa09-af451928e162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:28.771782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2e84c-c7b9-4c5f-aa09-af451928e162 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:28.794818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-18e2e84c-c7b9-4c5f-aa09-af451928e162 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 23:13:28.794818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:28.794818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 23 23:13:28.794818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 23 23:13:28.794818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:13:28.794818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:13:28.794818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:13:28.794818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:13:28.794818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 23 23:13:28.794818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:13:28.794818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:13:28.794818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:13:28.794818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:28.794818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:28.794818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:28.794818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:28.794818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:28.797061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:28.797061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:28.797061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:28.797061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:28.797061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:28.797061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:28.797061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:13:28.797061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:13:28.797061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:13:28.797061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:13:28.797061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:28.797061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:28.797061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:28.797061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:28.797061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:28.797061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:28.798805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:28.798805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:28.798805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:28.798805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:28.798805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:28.798805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:28.798805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:28.798805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:28.798805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:28.798805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:28.798805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 23 23:13:28.798805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:13:28.798805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 23:13:28.798805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:13:28.798805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 578/1165] 10.222.0.107 () {56 vars in 1122 bytes} [Tue Aug 23 23:13:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:13:28.802540 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0356d-1721-4187-b556-cfc17136a69b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:28.931427 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0356d-1721-4187-b556-cfc17136a69b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:28.967537 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f29452-bf65-45d2-944c-392e9d39cabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:28.968165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f29452-bf65-45d2-944c-392e9d39cabd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:28.968441 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f29452-bf65-45d2-944c-392e9d39cabd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:28.968748 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f29452-bf65-45d2-944c-392e9d39cabd None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:28.969406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f29452-bf65-45d2-944c-392e9d39cabd None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:28.969708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f29452-bf65-45d2-944c-392e9d39cabd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:28.971094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f29452-bf65-45d2-944c-392e9d39cabd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:28.979738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 588/1166] 10.222.0.107 () {56 vars in 1120 bytes} [Tue Aug 23 23:13:28 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:30.911673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c974178-a7e0-4f9a-95c3-114bef506ef7 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:30.912219 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c974178-a7e0-4f9a-95c3-114bef506ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:30.912219 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c974178-a7e0-4f9a-95c3-114bef506ef7 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:30.914058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 579/1167] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:13:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:13:30.919123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a957496-091c-431f-a17b-1bf487e62863 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:30.919600 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a957496-091c-431f-a17b-1bf487e62863 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:30.919703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a957496-091c-431f-a17b-1bf487e62863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:30.938908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5a957496-091c-431f-a17b-1bf487e62863 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:30.940123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5a957496-091c-431f-a17b-1bf487e62863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:30.995960 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:31.014576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 589/1168] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:13:30 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:31.283062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c974178-a7e0-4f9a-95c3-114bef506ef7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:31.386533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:31.401791 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c974178-a7e0-4f9a-95c3-114bef506ef7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:31.439435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc2b4b-40c4-4a0d-8d94-b2b939cab96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:31.440053 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc2b4b-40c4-4a0d-8d94-b2b939cab96b None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:31.440331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc2b4b-40c4-4a0d-8d94-b2b939cab96b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:31.440628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc2b4b-40c4-4a0d-8d94-b2b939cab96b None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:31.441316 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc2b4b-40c4-4a0d-8d94-b2b939cab96b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:31.442701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc2b4b-40c4-4a0d-8d94-b2b939cab96b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:31.461100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 580/1169] 10.222.0.107 () {60 vars in 1143 bytes} [Tue Aug 23 23:13:31 2022] POST /identity/v3/domains => generated 268 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:13:33.475168 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a2adb-9bf1-409f-acd8-d11020e88600 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:33.476248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a2adb-9bf1-409f-acd8-d11020e88600 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:33.476387 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a2adb-9bf1-409f-acd8-d11020e88600 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:33.477740 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 590/1170] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:13:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:13:33.483241 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d7dda-2d76-4192-9ece-f839081d582b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:33.483712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d7dda-2d76-4192-9ece-f839081d582b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:33.483814 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d7dda-2d76-4192-9ece-f839081d582b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:33.502539 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a07d7dda-2d76-4192-9ece-f839081d582b None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:33.503758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a07d7dda-2d76-4192-9ece-f839081d582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:33.578210 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 581/1171] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:13:33 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:33.863011 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a2adb-9bf1-409f-acd8-d11020e88600 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:33.975484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a2adb-9bf1-409f-acd8-d11020e88600 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:34.021766 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378a8f6-d6f0-4e7d-bbf2-3b9123a06770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:34.022334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378a8f6-d6f0-4e7d-bbf2-3b9123a06770 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:34.023456 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378a8f6-d6f0-4e7d-bbf2-3b9123a06770 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:34.023954 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378a8f6-d6f0-4e7d-bbf2-3b9123a06770 None admin] PATH_INFO: `/v3/domains/03612223d1644b28b34fc88fad821383` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:34.037715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378a8f6-d6f0-4e7d-bbf2-3b9123a06770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=03612223d1644b28b34fc88fad821383)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:34.039749 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378a8f6-d6f0-4e7d-bbf2-3b9123a06770 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:34.041615 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 591/1172] 10.222.0.107 () {56 vars in 1188 bytes} [Tue Aug 23 23:13:33 2022] GET /identity/v3/domains/03612223d1644b28b34fc88fad821383 => generated 268 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:34.049455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d7dda-2d76-4192-9ece-f839081d582b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:34.129354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:34.154075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d7dda-2d76-4192-9ece-f839081d582b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:34.188641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58d9e9-ce57-4233-9144-b479438edfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:34.189249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58d9e9-ce57-4233-9144-b479438edfae None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:34.189525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58d9e9-ce57-4233-9144-b479438edfae None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:34.189793 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58d9e9-ce57-4233-9144-b479438edfae None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:34.190429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58d9e9-ce57-4233-9144-b479438edfae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:34.191856 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58d9e9-ce57-4233-9144-b479438edfae None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:34.218948 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 582/1173] 10.222.0.107 () {60 vars in 1146 bytes} [Tue Aug 23 23:13:34 2022] POST /identity/v3/projects => generated 362 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:13:36.195516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26f40e-1fae-4448-8141-f1d97e57d6eb None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:36.196134 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26f40e-1fae-4448-8141-f1d97e57d6eb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:36.196134 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26f40e-1fae-4448-8141-f1d97e57d6eb None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:36.197542 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 592/1174] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:13:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:13:36.203583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d146f-523e-4e46-a8fe-9e3241fe7d3f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:36.204110 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d146f-523e-4e46-a8fe-9e3241fe7d3f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:36.204110 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d146f-523e-4e46-a8fe-9e3241fe7d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:36.228765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4f7d146f-523e-4e46-a8fe-9e3241fe7d3f None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:36.230278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4f7d146f-523e-4e46-a8fe-9e3241fe7d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:36.314299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 583/1175] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:13:36 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:36.592084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26f40e-1fae-4448-8141-f1d97e57d6eb None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:36.654563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:36.744003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26f40e-1fae-4448-8141-f1d97e57d6eb None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:36.787444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115beb6-aaa1-49a1-b49e-a8820e17a855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:36.789307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115beb6-aaa1-49a1-b49e-a8820e17a855 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:36.789701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115beb6-aaa1-49a1-b49e-a8820e17a855 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:36.789976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115beb6-aaa1-49a1-b49e-a8820e17a855 None admin] PATH_INFO: `/v3/domains/03612223d1644b28b34fc88fad821383` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:36.791325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115beb6-aaa1-49a1-b49e-a8820e17a855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=03612223d1644b28b34fc88fad821383)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:36.792812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115beb6-aaa1-49a1-b49e-a8820e17a855 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:36.794826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 593/1176] 10.222.0.107 () {56 vars in 1188 bytes} [Tue Aug 23 23:13:36 2022] GET /identity/v3/domains/03612223d1644b28b34fc88fad821383 => generated 268 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:36.803068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d146f-523e-4e46-a8fe-9e3241fe7d3f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:36.877349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:36.938210 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d146f-523e-4e46-a8fe-9e3241fe7d3f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:36.986246 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359b8b0-c525-458a-97c1-c02067d9574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:36.986873 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359b8b0-c525-458a-97c1-c02067d9574b None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:36.987153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359b8b0-c525-458a-97c1-c02067d9574b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:36.987425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359b8b0-c525-458a-97c1-c02067d9574b None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:36.988078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359b8b0-c525-458a-97c1-c02067d9574b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:36.989769 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359b8b0-c525-458a-97c1-c02067d9574b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:37.016634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 584/1177] 10.222.0.107 () {60 vars in 1137 bytes} [Tue Aug 23 23:13:36 2022] POST /identity/v3/users => generated 312 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:13:39.096525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e9f90-016c-475b-b4ae-169c1c5c6554 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:39.097222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e9f90-016c-475b-b4ae-169c1c5c6554 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:39.097222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e9f90-016c-475b-b4ae-169c1c5c6554 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:39.098455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 594/1178] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:13:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:13:39.105516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcc2d8-41c4-47af-b16e-91d42997babd None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:39.106098 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcc2d8-41c4-47af-b16e-91d42997babd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:39.106098 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcc2d8-41c4-47af-b16e-91d42997babd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:39.123773 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-60dcc2d8-41c4-47af-b16e-91d42997babd None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:39.125025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-60dcc2d8-41c4-47af-b16e-91d42997babd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:39.193749 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 585/1179] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:13:39 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:39.463204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e9f90-016c-475b-b4ae-169c1c5c6554 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:39.566723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e9f90-016c-475b-b4ae-169c1c5c6554 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:39.581319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:39.602166 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc08c0f-ea7f-4967-9637-844d7e2fd80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:39.602802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc08c0f-ea7f-4967-9637-844d7e2fd80c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:39.603117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc08c0f-ea7f-4967-9637-844d7e2fd80c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:39.603350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc08c0f-ea7f-4967-9637-844d7e2fd80c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:39.619468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc08c0f-ea7f-4967-9637-844d7e2fd80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:13:39.624201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ecc08c0f-ea7f-4967-9637-844d7e2fd80c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:13:39.624201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:39.624201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:39.624201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:39.624201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:39.624201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:39.624201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:39.624201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:39.624201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:39.624201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:39.624201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:39.624201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:39.624201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:13:39.624201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:13:39.624201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:13:39.624201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:13:39.625471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:13:39.625471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:13:39.625471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:13:39.625471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:13:39.625471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:39.625471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:39.625471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:39.625471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:39.625471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:39.625471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:39.625471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:39.625471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:39.625471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:39.625471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:39.625471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:39.625471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:39.626312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:39.626312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:39.626312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:39.626312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:39.626312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:13:39.626312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:13:39.626312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:13:39.626312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:13:39.626312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:13:39.626312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:13:39.626312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:13:39.626312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:13:39.626312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 595/1180] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:13:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:39.631439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcc2d8-41c4-47af-b16e-91d42997babd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:39.680586 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:39.740249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcc2d8-41c4-47af-b16e-91d42997babd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:39.778370 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49316616-65b0-46b4-a42b-fd3b20f35443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:39.778998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49316616-65b0-46b4-a42b-fd3b20f35443 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:39.779278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49316616-65b0-46b4-a42b-fd3b20f35443 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:39.779552 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49316616-65b0-46b4-a42b-fd3b20f35443 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:39.780276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49316616-65b0-46b4-a42b-fd3b20f35443 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:39.780581 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49316616-65b0-46b4-a42b-fd3b20f35443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:39.781998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49316616-65b0-46b4-a42b-fd3b20f35443 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:39.791492 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 586/1181] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:13:39 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:39.798590 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc08c0f-ea7f-4967-9637-844d7e2fd80c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:39.910064 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc08c0f-ea7f-4967-9637-844d7e2fd80c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:39.944842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd2d33-0101-4ba8-b5c1-1cb475c7c334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:39.945471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd2d33-0101-4ba8-b5c1-1cb475c7c334 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:39.945751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd2d33-0101-4ba8-b5c1-1cb475c7c334 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:39.946023 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd2d33-0101-4ba8-b5c1-1cb475c7c334 None admin] PATH_INFO: `/v3/users/cfd5066072d541a88ae18fadf13e1b6e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:39.959436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd2d33-0101-4ba8-b5c1-1cb475c7c334 None admin] RBAC: Authorizing `identity:get_user(user_id=cfd5066072d541a88ae18fadf13e1b6e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:39.961551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd2d33-0101-4ba8-b5c1-1cb475c7c334 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:39.963264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 596/1182] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:13:39 2022] GET /identity/v3/users/cfd5066072d541a88ae18fadf13e1b6e => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:39.969347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49316616-65b0-46b4-a42b-fd3b20f35443 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:40.084803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49316616-65b0-46b4-a42b-fd3b20f35443 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:40.095788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:40.121923 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc806f-b31b-40ce-bfbf-9aa85032e0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:40.122640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc806f-b31b-40ce-bfbf-9aa85032e0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:40.122805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc806f-b31b-40ce-bfbf-9aa85032e0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:40.123082 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc806f-b31b-40ce-bfbf-9aa85032e0e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:40.200436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc806f-b31b-40ce-bfbf-9aa85032e0e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:40.201935 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc806f-b31b-40ce-bfbf-9aa85032e0e8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:40.307060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 587/1183] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:13:39 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:13:40.313154 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd2d33-0101-4ba8-b5c1-1cb475c7c334 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:40.346245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:40.418290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd2d33-0101-4ba8-b5c1-1cb475c7c334 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:40.453327 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f868f8-707b-473b-8011-4a1bb5f69173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:40.453952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f868f8-707b-473b-8011-4a1bb5f69173 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:40.454225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f868f8-707b-473b-8011-4a1bb5f69173 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:40.454493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f868f8-707b-473b-8011-4a1bb5f69173 None admin] PATH_INFO: `/v3/projects/136d2ea6e8eb467eac24e715d09aa066` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:40.455605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f868f8-707b-473b-8011-4a1bb5f69173 None admin] RBAC: Authorizing `identity:get_project(project_id=136d2ea6e8eb467eac24e715d09aa066)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:40.457074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f868f8-707b-473b-8011-4a1bb5f69173 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:40.458711 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 597/1184] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:13:40 2022] GET /identity/v3/projects/136d2ea6e8eb467eac24e715d09aa066 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:40.465538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc806f-b31b-40ce-bfbf-9aa85032e0e8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:40.476476 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:40.585785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc806f-b31b-40ce-bfbf-9aa85032e0e8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:40.639546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4e3ba-69e7-45e2-bef1-26af29183394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:40.640145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4e3ba-69e7-45e2-bef1-26af29183394 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:40.640431 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4e3ba-69e7-45e2-bef1-26af29183394 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:40.640732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4e3ba-69e7-45e2-bef1-26af29183394 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:40.641468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4e3ba-69e7-45e2-bef1-26af29183394 None admin] RBAC: Adding query filter params (role.id=97ece22f2e264e0e857d5107325a85d9, scope.project.id=136d2ea6e8eb467eac24e715d09aa066, user.id=cfd5066072d541a88ae18fadf13e1b6e) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:40.641774 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4e3ba-69e7-45e2-bef1-26af29183394 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:40.643217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4e3ba-69e7-45e2-bef1-26af29183394 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:40.649227 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 588/1185] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:13:40 2022] GET /identity/v3/role_assignments?user.id=cfd5066072d541a88ae18fadf13e1b6e&scope.project.id=136d2ea6e8eb467eac24e715d09aa066&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:42.661298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db9488-0ba7-4464-b6b1-e88077431946 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:42.662001 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db9488-0ba7-4464-b6b1-e88077431946 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:42.662001 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db9488-0ba7-4464-b6b1-e88077431946 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:42.663234 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 598/1186] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:13:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:13:42.668799 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33192053-8a9c-413a-b076-3aa3836c7fdf None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:42.669247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33192053-8a9c-413a-b076-3aa3836c7fdf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:42.669347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33192053-8a9c-413a-b076-3aa3836c7fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:42.688351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-33192053-8a9c-413a-b076-3aa3836c7fdf None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:42.689606 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-33192053-8a9c-413a-b076-3aa3836c7fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:42.762910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 589/1187] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:13:42 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:13:43.045116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db9488-0ba7-4464-b6b1-e88077431946 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:43.149039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:43.153434 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db9488-0ba7-4464-b6b1-e88077431946 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:43.187942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa29b89-2a5a-48e4-bbb8-f68c086281db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:43.188567 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa29b89-2a5a-48e4-bbb8-f68c086281db None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:43.188891 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa29b89-2a5a-48e4-bbb8-f68c086281db None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:43.189156 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa29b89-2a5a-48e4-bbb8-f68c086281db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:43.199989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa29b89-2a5a-48e4-bbb8-f68c086281db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:13:43.204654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-cfa29b89-2a5a-48e4-bbb8-f68c086281db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:13:43.204654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:43.204654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:43.204654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:43.204654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:43.204654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:43.204654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:43.204654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:43.204654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:43.204654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:43.204654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:43.204654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:43.204654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:13:43.204654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:13:43.204654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:13:43.204654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:13:43.205782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:13:43.205782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:13:43.205782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:13:43.205782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:13:43.205782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:43.205782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:43.205782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:43.205782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:43.205782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:43.205782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:43.205782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:43.205782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:43.205782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:43.205782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:43.205782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:43.205782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:43.206634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:43.206634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:43.206634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:43.206634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:43.206634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:13:43.206634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:13:43.206634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:13:43.206634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:13:43.206634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:13:43.206634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:13:43.206634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:13:43.206634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:13:43.206634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 599/1188] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:13:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:13:43.212847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33192053-8a9c-413a-b076-3aa3836c7fdf None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:43.215060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:43.326873 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33192053-8a9c-413a-b076-3aa3836c7fdf None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:43.364321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75879446-bd24-4075-b1e1-c38ace1f73fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:43.364966 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75879446-bd24-4075-b1e1-c38ace1f73fd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:43.365251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75879446-bd24-4075-b1e1-c38ace1f73fd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:43.365523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75879446-bd24-4075-b1e1-c38ace1f73fd None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:43.366198 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75879446-bd24-4075-b1e1-c38ace1f73fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:43.366532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75879446-bd24-4075-b1e1-c38ace1f73fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:43.367928 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75879446-bd24-4075-b1e1-c38ace1f73fd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:43.376873 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 590/1189] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:13:43 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:43.383653 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa29b89-2a5a-48e4-bbb8-f68c086281db None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:43.499290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa29b89-2a5a-48e4-bbb8-f68c086281db None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:43.534372 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288e2f4-4297-49f7-8fa0-8ef0a54053bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:43.535005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288e2f4-4297-49f7-8fa0-8ef0a54053bc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:43.535282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288e2f4-4297-49f7-8fa0-8ef0a54053bc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:43.535553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288e2f4-4297-49f7-8fa0-8ef0a54053bc None admin] PATH_INFO: `/v3/users/cfd5066072d541a88ae18fadf13e1b6e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:43.536704 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288e2f4-4297-49f7-8fa0-8ef0a54053bc None admin] RBAC: Authorizing `identity:get_user(user_id=cfd5066072d541a88ae18fadf13e1b6e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:43.538141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288e2f4-4297-49f7-8fa0-8ef0a54053bc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:43.540525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 600/1190] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:13:43 2022] GET /identity/v3/users/cfd5066072d541a88ae18fadf13e1b6e => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:43.546967 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75879446-bd24-4075-b1e1-c38ace1f73fd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:43.609906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:43.649671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75879446-bd24-4075-b1e1-c38ace1f73fd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:43.686702 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d334a04-36ca-4d93-9538-bda892299b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:43.687423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d334a04-36ca-4d93-9538-bda892299b1f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:43.687593 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d334a04-36ca-4d93-9538-bda892299b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:43.687863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d334a04-36ca-4d93-9538-bda892299b1f None admin] PATH_INFO: `/v3/projects/136d2ea6e8eb467eac24e715d09aa066` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:43.689012 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d334a04-36ca-4d93-9538-bda892299b1f None admin] RBAC: Authorizing `identity:get_project(project_id=136d2ea6e8eb467eac24e715d09aa066)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:43.690449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d334a04-36ca-4d93-9538-bda892299b1f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:43.692084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 591/1191] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:13:43 2022] GET /identity/v3/projects/136d2ea6e8eb467eac24e715d09aa066 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:43.699131 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288e2f4-4297-49f7-8fa0-8ef0a54053bc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:43.727326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:43.802155 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288e2f4-4297-49f7-8fa0-8ef0a54053bc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:43.845285 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afa5a6-c28a-4d7d-9524-c0add97e7346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:43.845955 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afa5a6-c28a-4d7d-9524-c0add97e7346 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:43.846231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afa5a6-c28a-4d7d-9524-c0add97e7346 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:43.846500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afa5a6-c28a-4d7d-9524-c0add97e7346 None admin] PATH_INFO: `/v3/projects/136d2ea6e8eb467eac24e715d09aa066/users/cfd5066072d541a88ae18fadf13e1b6e/roles/97ece22f2e264e0e857d5107325a85d9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:43.848424 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afa5a6-c28a-4d7d-9524-c0add97e7346 None admin] RBAC: Authorizing `identity:create_grant(project_id=136d2ea6e8eb467eac24e715d09aa066, user_id=cfd5066072d541a88ae18fadf13e1b6e, role_id=97ece22f2e264e0e857d5107325a85d9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:43.849878 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afa5a6-c28a-4d7d-9524-c0add97e7346 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:43.864134 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 601/1192] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:13:43 2022] PUT /identity/v3/projects/136d2ea6e8eb467eac24e715d09aa066/users/cfd5066072d541a88ae18fadf13e1b6e/roles/97ece22f2e264e0e857d5107325a85d9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:13:45.811178 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c4533-8068-4f08-9526-fae70c0057c4 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:45.811736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c4533-8068-4f08-9526-fae70c0057c4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:45.811736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c4533-8068-4f08-9526-fae70c0057c4 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:45.813090 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 592/1193] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:13:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:13:45.818461 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4e682-9dda-405c-9d39-781ff85bdb89 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:45.818872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4e682-9dda-405c-9d39-781ff85bdb89 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:45.819024 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4e682-9dda-405c-9d39-781ff85bdb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:45.837600 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-71d4e682-9dda-405c-9d39-781ff85bdb89 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:45.838764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-71d4e682-9dda-405c-9d39-781ff85bdb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:45.903672 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 602/1194] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:13:45 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:13:46.172695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c4533-8068-4f08-9526-fae70c0057c4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:46.273822 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c4533-8068-4f08-9526-fae70c0057c4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:46.304547 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:46.310067 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e60da-20eb-4ef3-bbb1-4aee3f58dd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:46.310693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e60da-20eb-4ef3-bbb1-4aee3f58dd9e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:46.310968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e60da-20eb-4ef3-bbb1-4aee3f58dd9e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:46.311239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e60da-20eb-4ef3-bbb1-4aee3f58dd9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:46.321271 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e60da-20eb-4ef3-bbb1-4aee3f58dd9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:13:46.325865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e79e60da-20eb-4ef3-bbb1-4aee3f58dd9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:13:46.325865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:13:46.325865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:13:46.325865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:13:46.325865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:13:46.325865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:13:46.325865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:13:46.325865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:13:46.325865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:13:46.325865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:13:46.325865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:13:46.325865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:13:46.325865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:13:46.325865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:13:46.325865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:13:46.325865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:13:46.327038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:13:46.327038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:13:46.327038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:13:46.327038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:13:46.327038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:13:46.327038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:13:46.327038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:13:46.327038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:13:46.327038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:13:46.327038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:13:46.327038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:13:46.327038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:13:46.327038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:13:46.327038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:13:46.327038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:13:46.327038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:13:46.328127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:13:46.328127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:13:46.328127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:13:46.328127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:13:46.328127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:13:46.328127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:13:46.328127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:13:46.328127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:13:46.328127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:13:46.328127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:13:46.328127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:13:46.328127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:13:46.328127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 593/1195] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:13:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:13:46.333052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4e682-9dda-405c-9d39-781ff85bdb89 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:46.351234 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:46.433504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4e682-9dda-405c-9d39-781ff85bdb89 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:46.465847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d4505-bd01-46e7-8284-ebbe7e223234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:46.466454 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d4505-bd01-46e7-8284-ebbe7e223234 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:46.466730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d4505-bd01-46e7-8284-ebbe7e223234 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:46.466997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d4505-bd01-46e7-8284-ebbe7e223234 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:46.467649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d4505-bd01-46e7-8284-ebbe7e223234 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:46.467947 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d4505-bd01-46e7-8284-ebbe7e223234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:46.469349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d4505-bd01-46e7-8284-ebbe7e223234 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:46.477789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 603/1196] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:13:46 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:46.483924 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e60da-20eb-4ef3-bbb1-4aee3f58dd9e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:46.580140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e60da-20eb-4ef3-bbb1-4aee3f58dd9e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:46.615315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d6cb6-837f-4e05-a4c5-c7ffca80d979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:46.615922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d6cb6-837f-4e05-a4c5-c7ffca80d979 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:46.616195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d6cb6-837f-4e05-a4c5-c7ffca80d979 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:46.617018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d6cb6-837f-4e05-a4c5-c7ffca80d979 None admin] PATH_INFO: `/v3/users/cfd5066072d541a88ae18fadf13e1b6e` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:46.618221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d6cb6-837f-4e05-a4c5-c7ffca80d979 None admin] RBAC: Authorizing `identity:get_user(user_id=cfd5066072d541a88ae18fadf13e1b6e)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:46.619634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d6cb6-837f-4e05-a4c5-c7ffca80d979 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:46.621226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 594/1197] 10.222.0.107 () {56 vars in 1182 bytes} [Tue Aug 23 23:13:46 2022] GET /identity/v3/users/cfd5066072d541a88ae18fadf13e1b6e => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:46.627623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d4505-bd01-46e7-8284-ebbe7e223234 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:46.708369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:46.728439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d4505-bd01-46e7-8284-ebbe7e223234 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:46.762062 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4401da-2ebf-45d2-81b0-76487759bf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:46.762661 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4401da-2ebf-45d2-81b0-76487759bf0b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:46.762936 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4401da-2ebf-45d2-81b0-76487759bf0b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:46.763206 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4401da-2ebf-45d2-81b0-76487759bf0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:46.829000 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4401da-2ebf-45d2-81b0-76487759bf0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:46.830433 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4401da-2ebf-45d2-81b0-76487759bf0b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:46.909160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:46.933023 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 604/1198] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:13:46 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:13:46.940743 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d6cb6-837f-4e05-a4c5-c7ffca80d979 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:47.008786 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:47.049355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d6cb6-837f-4e05-a4c5-c7ffca80d979 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:47.082896 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ad37f-92f4-445a-9781-bf6bacd2120f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:47.083520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ad37f-92f4-445a-9781-bf6bacd2120f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:47.083795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ad37f-92f4-445a-9781-bf6bacd2120f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:47.084069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ad37f-92f4-445a-9781-bf6bacd2120f None admin] PATH_INFO: `/v3/projects/136d2ea6e8eb467eac24e715d09aa066` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:47.085282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ad37f-92f4-445a-9781-bf6bacd2120f None admin] RBAC: Authorizing `identity:get_project(project_id=136d2ea6e8eb467eac24e715d09aa066)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:47.087325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ad37f-92f4-445a-9781-bf6bacd2120f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:47.088982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 595/1199] 10.222.0.107 () {56 vars in 1191 bytes} [Tue Aug 23 23:13:46 2022] GET /identity/v3/projects/136d2ea6e8eb467eac24e715d09aa066 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:47.095198 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4401da-2ebf-45d2-81b0-76487759bf0b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:47.192031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4401da-2ebf-45d2-81b0-76487759bf0b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:47.224957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b0058-3d64-4d77-8c8f-b53486d2e26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:47.225549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b0058-3d64-4d77-8c8f-b53486d2e26b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:47.225857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b0058-3d64-4d77-8c8f-b53486d2e26b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:47.226123 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b0058-3d64-4d77-8c8f-b53486d2e26b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:47.226831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b0058-3d64-4d77-8c8f-b53486d2e26b None admin] RBAC: Adding query filter params (role.id=97ece22f2e264e0e857d5107325a85d9, scope.project.id=136d2ea6e8eb467eac24e715d09aa066, user.id=cfd5066072d541a88ae18fadf13e1b6e) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:13:47.227135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b0058-3d64-4d77-8c8f-b53486d2e26b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:47.228543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b0058-3d64-4d77-8c8f-b53486d2e26b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:47.234178 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 605/1200] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:13:47 2022] GET /identity/v3/role_assignments?user.id=cfd5066072d541a88ae18fadf13e1b6e&scope.project.id=136d2ea6e8eb467eac24e715d09aa066&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 610 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:13:57.078647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=36 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:57.231633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=78 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:43.518763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0019a2-e1f5-4bc6-9362-45d5bcecfb8c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:43.519377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0019a2-e1f5-4bc6-9362-45d5bcecfb8c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:43.519377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0019a2-e1f5-4bc6-9362-45d5bcecfb8c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:43.520701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 596/1201] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:14:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:14:43.527186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070db77-c417-4ca9-8ebe-9e7accf6e152 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:43.527750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070db77-c417-4ca9-8ebe-9e7accf6e152 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:43.527750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070db77-c417-4ca9-8ebe-9e7accf6e152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:43.550992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e070db77-c417-4ca9-8ebe-9e7accf6e152 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:43.552575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e070db77-c417-4ca9-8ebe-9e7accf6e152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:43.642484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 606/1202] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:14:43 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:14:43.926912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0019a2-e1f5-4bc6-9362-45d5bcecfb8c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:44.075470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0019a2-e1f5-4bc6-9362-45d5bcecfb8c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:44.121746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d4205-6ef1-4d56-a057-1e620591ac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:44.122392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d4205-6ef1-4d56-a057-1e620591ac0f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:44.122821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d4205-6ef1-4d56-a057-1e620591ac0f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:44.123124 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d4205-6ef1-4d56-a057-1e620591ac0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:44.138344 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d4205-6ef1-4d56-a057-1e620591ac0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:44.139858 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d4205-6ef1-4d56-a057-1e620591ac0f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:44.161084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-0e6d4205-6ef1-4d56-a057-1e620591ac0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:14:44.161084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:14:44.161084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:14:44.161084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:14:44.161084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:14:44.161084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:14:44.161084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:14:44.161084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:14:44.161084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:14:44.161084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:14:44.161084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:14:44.161084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:14:44.161084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:14:44.161084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:14:44.161084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:14:44.161084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:14:44.162286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:14:44.162286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:14:44.162286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:14:44.162286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:14:44.162286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:14:44.162286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:14:44.162286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:14:44.162286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:14:44.162286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:14:44.162286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:14:44.162286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:14:44.162286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:14:44.162286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:14:44.162286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:14:44.162286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:14:44.162286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:14:44.162286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:14:44.163335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:14:44.163335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:14:44.163335 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:14:44.165296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 597/1203] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:14:44.171469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070db77-c417-4ca9-8ebe-9e7accf6e152 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:44.301072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070db77-c417-4ca9-8ebe-9e7accf6e152 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:44.342329 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:44.350003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b704e51-d070-4252-b808-fece71e4ccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:44.350630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b704e51-d070-4252-b808-fece71e4ccf3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:44.350888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b704e51-d070-4252-b808-fece71e4ccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:44.351724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b704e51-d070-4252-b808-fece71e4ccf3 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:44.352366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b704e51-d070-4252-b808-fece71e4ccf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:14:44.352707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b704e51-d070-4252-b808-fece71e4ccf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:44.354090 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b704e51-d070-4252-b808-fece71e4ccf3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:44.376403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 607/1204] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:14:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:14:44.378198 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d4205-6ef1-4d56-a057-1e620591ac0f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:44.456060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:44.527092 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d4205-6ef1-4d56-a057-1e620591ac0f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:44.573450 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f24f3c-4137-4fc0-8d5b-97e69c2e00ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:44.574462 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f24f3c-4137-4fc0-8d5b-97e69c2e00ee None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:44.575064 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f24f3c-4137-4fc0-8d5b-97e69c2e00ee None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:44.575562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f24f3c-4137-4fc0-8d5b-97e69c2e00ee None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:44.576536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f24f3c-4137-4fc0-8d5b-97e69c2e00ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:44.578425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f24f3c-4137-4fc0-8d5b-97e69c2e00ee None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:44.609038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 598/1205] 10.222.0.107 () {60 vars in 1137 bytes} [Tue Aug 23 23:14:44 2022] POST /identity/v3/users => generated 252 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:14:46.851547 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9572e-58ca-407b-a24f-fc44138ee9de None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:46.852098 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9572e-58ca-407b-a24f-fc44138ee9de None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:46.852098 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9572e-58ca-407b-a24f-fc44138ee9de None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:46.853469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 608/1206] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:14:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:14:46.859048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880dd77-f209-41af-8ccf-d2797e1ed415 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:46.859528 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880dd77-f209-41af-8ccf-d2797e1ed415 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:46.859613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880dd77-f209-41af-8ccf-d2797e1ed415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:46.880405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6880dd77-f209-41af-8ccf-d2797e1ed415 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:46.881673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6880dd77-f209-41af-8ccf-d2797e1ed415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:46.957952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 599/1207] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:14:46 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:14:47.230957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9572e-58ca-407b-a24f-fc44138ee9de None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:47.393459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9572e-58ca-407b-a24f-fc44138ee9de None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:47.432468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e5836-d787-4f62-ad59-37ae8cc7fa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:47.433164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e5836-d787-4f62-ad59-37ae8cc7fa07 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:47.433445 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e5836-d787-4f62-ad59-37ae8cc7fa07 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:47.433715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e5836-d787-4f62-ad59-37ae8cc7fa07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:47.446929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e5836-d787-4f62-ad59-37ae8cc7fa07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:14:47.452121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-939e5836-d787-4f62-ad59-37ae8cc7fa07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:14:47.452121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:14:47.452121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:14:47.452121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:14:47.452121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:14:47.452121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:14:47.452121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:14:47.452121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:14:47.452121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:14:47.452121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:14:47.452121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:14:47.452121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:14:47.452121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:14:47.452121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:14:47.452121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:14:47.452121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:14:47.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:14:47.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:14:47.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:14:47.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:14:47.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:14:47.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:14:47.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:14:47.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:14:47.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:14:47.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:14:47.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:14:47.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:14:47.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:14:47.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:14:47.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:14:47.453193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:14:47.454071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:14:47.454071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:14:47.454071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:14:47.454071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:14:47.454071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:14:47.454071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:14:47.454071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:14:47.454071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:14:47.454071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:14:47.454071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:14:47.454071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:14:47.454071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:14:47.454071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 609/1208] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:14:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:14:47.459745 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880dd77-f209-41af-8ccf-d2797e1ed415 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:47.503780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:47.574605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880dd77-f209-41af-8ccf-d2797e1ed415 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:47.613576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd8aa9-d0c4-4426-b818-e42a58ca40b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:47.614482 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd8aa9-d0c4-4426-b818-e42a58ca40b2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:47.614916 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd8aa9-d0c4-4426-b818-e42a58ca40b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:47.615380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd8aa9-d0c4-4426-b818-e42a58ca40b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:47.616315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd8aa9-d0c4-4426-b818-e42a58ca40b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:14:47.616763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd8aa9-d0c4-4426-b818-e42a58ca40b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:47.619179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd8aa9-d0c4-4426-b818-e42a58ca40b2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:47.628865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 600/1209] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:14:47 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:14:47.635144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e5836-d787-4f62-ad59-37ae8cc7fa07 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:47.694523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:47.763726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e5836-d787-4f62-ad59-37ae8cc7fa07 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:47.812351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e7aa1-f194-48c2-9a7c-c44bc546e68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:47.813207 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e7aa1-f194-48c2-9a7c-c44bc546e68e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:47.813628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e7aa1-f194-48c2-9a7c-c44bc546e68e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:47.813996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e7aa1-f194-48c2-9a7c-c44bc546e68e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:47.828589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e7aa1-f194-48c2-9a7c-c44bc546e68e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:47.830565 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e7aa1-f194-48c2-9a7c-c44bc546e68e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:47.850432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-118e7aa1-f194-48c2-9a7c-c44bc546e68e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:14:47.850432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:14:47.850432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:14:47.850432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:14:47.850432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:14:47.850432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:14:47.850432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:14:47.850432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:14:47.850432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:14:47.850432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:14:47.850432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:14:47.850432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:14:47.850432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:14:47.850432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:14:47.850432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:14:47.850432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:14:47.857721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:14:47.857721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:14:47.857721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:14:47.857721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:14:47.857721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:14:47.857721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:14:47.857721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:14:47.857721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:14:47.857721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:14:47.857721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:14:47.857721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:14:47.857721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:14:47.857721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:14:47.857721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:14:47.857721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:14:47.857721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:14:47.857721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:14:47.858843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:14:47.858843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:14:47.858843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:14:47.858843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 610/1210] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:14:47.860963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd8aa9-d0c4-4426-b818-e42a58ca40b2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:47.974790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:47.978265 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd8aa9-d0c4-4426-b818-e42a58ca40b2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:48.024379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16a439-1f18-44d9-87ee-f2947e61c6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:48.025146 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16a439-1f18-44d9-87ee-f2947e61c6cd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:48.025470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16a439-1f18-44d9-87ee-f2947e61c6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:48.025880 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16a439-1f18-44d9-87ee-f2947e61c6cd None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:48.026647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16a439-1f18-44d9-87ee-f2947e61c6cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:14:48.027017 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16a439-1f18-44d9-87ee-f2947e61c6cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:48.028627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16a439-1f18-44d9-87ee-f2947e61c6cd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:48.051532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 601/1211] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:14:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:14:48.053382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e7aa1-f194-48c2-9a7c-c44bc546e68e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:48.172919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e7aa1-f194-48c2-9a7c-c44bc546e68e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:48.174975 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:48.214457 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029d14a-9971-440d-bca0-07907dee722d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:48.215091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029d14a-9971-440d-bca0-07907dee722d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:48.215375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029d14a-9971-440d-bca0-07907dee722d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:48.215686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029d14a-9971-440d-bca0-07907dee722d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:48.224913 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029d14a-9971-440d-bca0-07907dee722d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:48.227616 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029d14a-9971-440d-bca0-07907dee722d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:48.239934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a029d14a-9971-440d-bca0-07907dee722d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:14:48.239934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:14:48.239934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:14:48.239934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:14:48.239934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:14:48.239934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:14:48.239934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:14:48.239934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:14:48.239934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:14:48.239934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:14:48.239934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:14:48.239934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:14:48.239934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:14:48.239934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:14:48.239934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:14:48.239934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:14:48.241301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:14:48.241301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:14:48.241301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:14:48.241301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:14:48.241301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:14:48.241301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:14:48.241301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:14:48.241301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:14:48.241301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:14:48.241301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:14:48.241301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:14:48.241301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:14:48.241301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:14:48.241301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:14:48.241301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:14:48.241301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:14:48.241301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:14:48.241301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:14:48.242957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:14:48.242957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:14:48.242957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:14:48.242957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:14:48.242957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:14:48.242957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:14:48.242957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:14:48.242957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:14:48.242957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:14:48.242957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:14:48.242957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 611/1212] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:14:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:14:48.248888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16a439-1f18-44d9-87ee-f2947e61c6cd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:48.390916 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16a439-1f18-44d9-87ee-f2947e61c6cd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:48.434296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4a926-2e4d-4f3c-a5ba-d8c871c149fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:48.434946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4a926-2e4d-4f3c-a5ba-d8c871c149fe None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:48.435259 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4a926-2e4d-4f3c-a5ba-d8c871c149fe None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:48.435516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4a926-2e4d-4f3c-a5ba-d8c871c149fe None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:48.436228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4a926-2e4d-4f3c-a5ba-d8c871c149fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:14:48.436532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4a926-2e4d-4f3c-a5ba-d8c871c149fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:48.438015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4a926-2e4d-4f3c-a5ba-d8c871c149fe None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:48.457978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 602/1213] 10.222.0.107 () {56 vars in 1148 bytes} [Tue Aug 23 23:14:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:14:48.463895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029d14a-9971-440d-bca0-07907dee722d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:48.584363 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029d14a-9971-440d-bca0-07907dee722d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:48.626154 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51733d-6cc6-41dd-9c0e-47450319695c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:48.626764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51733d-6cc6-41dd-9c0e-47450319695c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:48.627044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51733d-6cc6-41dd-9c0e-47450319695c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:48.627316 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51733d-6cc6-41dd-9c0e-47450319695c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:48.664188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:48.710816 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51733d-6cc6-41dd-9c0e-47450319695c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:48.713562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51733d-6cc6-41dd-9c0e-47450319695c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:48.847531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 612/1214] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:14:48 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 23:14:48.852557 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4a926-2e4d-4f3c-a5ba-d8c871c149fe None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:48.876021 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:48.987320 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4a926-2e4d-4f3c-a5ba-d8c871c149fe None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:49.031953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfc3a5-c9eb-4d8d-93d4-b6522519dd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:49.032618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfc3a5-c9eb-4d8d-93d4-b6522519dd3f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:49.032907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfc3a5-c9eb-4d8d-93d4-b6522519dd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:49.033206 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfc3a5-c9eb-4d8d-93d4-b6522519dd3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:49.045275 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfc3a5-c9eb-4d8d-93d4-b6522519dd3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:49.049659 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfc3a5-c9eb-4d8d-93d4-b6522519dd3f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:49.068626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3ecfc3a5-c9eb-4d8d-93d4-b6522519dd3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:14:49.068626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:14:49.068626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:14:49.068626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:14:49.068626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:14:49.068626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:14:49.068626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:14:49.068626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:14:49.068626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:14:49.068626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:14:49.068626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:14:49.068626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:14:49.068626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:14:49.068626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:14:49.068626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:14:49.068626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:14:49.075052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:14:49.075052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:14:49.075052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:14:49.075052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:14:49.075052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:14:49.075052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:14:49.075052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:14:49.075052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:14:49.075052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:14:49.075052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:14:49.075052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:14:49.075052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:14:49.075052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:14:49.075052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:14:49.075052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:14:49.075052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:14:49.075052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:14:49.076059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:14:49.076059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:14:49.076059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:14:49.076059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 603/1215] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:14:49.077309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51733d-6cc6-41dd-9c0e-47450319695c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:49.145888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:49.200262 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51733d-6cc6-41dd-9c0e-47450319695c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:49.238234 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a73b2b-cee8-4198-ab6b-4a1ae3b0e79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:49.238886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a73b2b-cee8-4198-ab6b-4a1ae3b0e79a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:49.239227 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a73b2b-cee8-4198-ab6b-4a1ae3b0e79a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:49.239452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a73b2b-cee8-4198-ab6b-4a1ae3b0e79a None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:49.240088 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a73b2b-cee8-4198-ab6b-4a1ae3b0e79a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:14:49.240362 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a73b2b-cee8-4198-ab6b-4a1ae3b0e79a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:49.241879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a73b2b-cee8-4198-ab6b-4a1ae3b0e79a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:49.255211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 613/1216] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:14:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:14:49.263469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfc3a5-c9eb-4d8d-93d4-b6522519dd3f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:49.371795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:49.410229 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfc3a5-c9eb-4d8d-93d4-b6522519dd3f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:49.464719 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3873d69-a23b-4c7d-b255-bb76ba041834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:49.465350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3873d69-a23b-4c7d-b255-bb76ba041834 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:49.465630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3873d69-a23b-4c7d-b255-bb76ba041834 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:49.465914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3873d69-a23b-4c7d-b255-bb76ba041834 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:49.473645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3873d69-a23b-4c7d-b255-bb76ba041834 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:49.475269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3873d69-a23b-4c7d-b255-bb76ba041834 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:49.488830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f3873d69-a23b-4c7d-b255-bb76ba041834 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:14:49.488830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:14:49.488830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:14:49.488830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:14:49.488830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:14:49.488830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:14:49.488830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:14:49.488830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:14:49.488830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:14:49.488830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:14:49.488830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:14:49.488830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:14:49.488830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:14:49.488830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:14:49.488830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:14:49.489851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:14:49.489851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:14:49.489851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:14:49.489851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:14:49.489851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:14:49.489851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:14:49.489851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:14:49.489851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:14:49.489851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:14:49.489851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:14:49.489851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:14:49.489851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:14:49.489851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:14:49.489851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:14:49.489851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:14:49.489851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:14:49.489851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:14:49.490806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:14:49.490806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:14:49.490806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:14:49.490806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:14:49.490806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:14:49.490806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:14:49.490806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:14:49.490806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:14:49.490806 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 604/1217] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:14:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:14:49.495757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a73b2b-cee8-4198-ab6b-4a1ae3b0e79a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:49.616349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a73b2b-cee8-4198-ab6b-4a1ae3b0e79a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:49.648351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:49.665955 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b721a27-a413-4862-b276-cc1413743e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:49.666621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b721a27-a413-4862-b276-cc1413743e57 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:49.667002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b721a27-a413-4862-b276-cc1413743e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:49.667334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b721a27-a413-4862-b276-cc1413743e57 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:49.668156 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b721a27-a413-4862-b276-cc1413743e57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:14:49.668549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b721a27-a413-4862-b276-cc1413743e57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:49.670171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b721a27-a413-4862-b276-cc1413743e57 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:49.691637 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 614/1218] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:14:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:14:49.694382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3873d69-a23b-4c7d-b255-bb76ba041834 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:49.823681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3873d69-a23b-4c7d-b255-bb76ba041834 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:49.858820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:49.867459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb88e67-67cb-44be-8366-6f1812875e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:49.868834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb88e67-67cb-44be-8366-6f1812875e62 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:49.868834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb88e67-67cb-44be-8366-6f1812875e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:49.869050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb88e67-67cb-44be-8366-6f1812875e62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:49.869880 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb88e67-67cb-44be-8366-6f1812875e62 None admin] RBAC: Adding query filter params (role.id=ee7f9512e7e745199ff5ed847343d11a, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=14ee6ffc0985405193735af49a398326) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:14:49.870180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb88e67-67cb-44be-8366-6f1812875e62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:49.871616 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb88e67-67cb-44be-8366-6f1812875e62 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:49.877947 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 605/1219] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:14:49 2022] GET /identity/v3/role_assignments?user.id=14ee6ffc0985405193735af49a398326&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=ee7f9512e7e745199ff5ed847343d11a => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:14:51.862911 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c83f2-b8e3-4557-8094-4fb0aebd73bb None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:51.863443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c83f2-b8e3-4557-8094-4fb0aebd73bb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:51.863443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c83f2-b8e3-4557-8094-4fb0aebd73bb None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:51.865055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 615/1220] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:14:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:14:51.872428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0d72d-9bc0-4602-bbfb-1bb4a85e8cfc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:51.873176 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0d72d-9bc0-4602-bbfb-1bb4a85e8cfc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:51.873779 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0d72d-9bc0-4602-bbfb-1bb4a85e8cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:51.899176 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-74b0d72d-9bc0-4602-bbfb-1bb4a85e8cfc None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:51.900578 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-74b0d72d-9bc0-4602-bbfb-1bb4a85e8cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:51.975372 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 606/1221] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:14:51 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:14:52.269589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c83f2-b8e3-4557-8094-4fb0aebd73bb None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:52.387628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c83f2-b8e3-4557-8094-4fb0aebd73bb None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:52.428855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22ba32-b362-4bbd-a742-082966c0beb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:52.429600 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22ba32-b362-4bbd-a742-082966c0beb1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:52.429979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22ba32-b362-4bbd-a742-082966c0beb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:52.430283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22ba32-b362-4bbd-a742-082966c0beb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:52.444072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22ba32-b362-4bbd-a742-082966c0beb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:14:52.449115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ae22ba32-b362-4bbd-a742-082966c0beb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:14:52.449115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:14:52.449115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:14:52.449115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:14:52.449115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:14:52.449115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:14:52.449115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:14:52.449115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:14:52.449115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:14:52.449115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:14:52.449115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:14:52.449115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:14:52.449115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:14:52.449115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:14:52.449115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:14:52.449115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:14:52.450187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:14:52.450187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:14:52.450187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:14:52.450187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:14:52.450187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:14:52.450187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:14:52.450187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:14:52.450187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:14:52.450187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:14:52.450187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:14:52.450187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:14:52.450187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:14:52.450187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:14:52.450187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:14:52.450187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:14:52.450187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:14:52.451104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:14:52.451104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:14:52.451104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:14:52.451104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:14:52.451104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:14:52.451104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:14:52.451104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:14:52.451104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:14:52.451104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:14:52.451104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:14:52.451104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:14:52.451104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:14:52.451104 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 616/1222] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:14:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:14:52.456655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0d72d-9bc0-4602-bbfb-1bb4a85e8cfc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:52.562804 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0d72d-9bc0-4602-bbfb-1bb4a85e8cfc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:52.587793 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:52.599046 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba5a25-12d0-49a8-8827-46d31a0f5eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:52.599647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba5a25-12d0-49a8-8827-46d31a0f5eeb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:52.599927 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba5a25-12d0-49a8-8827-46d31a0f5eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:52.600202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba5a25-12d0-49a8-8827-46d31a0f5eeb None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:52.600915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba5a25-12d0-49a8-8827-46d31a0f5eeb None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:14:52.601818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba5a25-12d0-49a8-8827-46d31a0f5eeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:52.603259 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba5a25-12d0-49a8-8827-46d31a0f5eeb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:52.611656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 607/1223] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:14:52 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:14:52.618308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22ba32-b362-4bbd-a742-082966c0beb1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:52.664882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:52.730290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22ba32-b362-4bbd-a742-082966c0beb1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:52.769233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc091fc-7eec-454d-9f45-777e4b8e290d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:52.769856 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc091fc-7eec-454d-9f45-777e4b8e290d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:52.770128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc091fc-7eec-454d-9f45-777e4b8e290d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:52.770393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc091fc-7eec-454d-9f45-777e4b8e290d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:52.781228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc091fc-7eec-454d-9f45-777e4b8e290d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:52.782790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc091fc-7eec-454d-9f45-777e4b8e290d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:52.799642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-1fc091fc-7eec-454d-9f45-777e4b8e290d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:14:52.799642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:14:52.799642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:14:52.799642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:14:52.799642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:14:52.799642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:14:52.799642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:14:52.799642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:14:52.799642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:14:52.799642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:14:52.799642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:14:52.799642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:14:52.799642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:14:52.799642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:14:52.799642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:14:52.799642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:14:52.800705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:14:52.800705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:14:52.800705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:14:52.800705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:14:52.800705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:14:52.800705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:14:52.800705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:14:52.800705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:14:52.800705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:14:52.800705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:14:52.800705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:14:52.800705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:14:52.800705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:14:52.800705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:14:52.800705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:14:52.800705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:14:52.800705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:14:52.801691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:14:52.801691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:14:52.801691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:14:52.801691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 617/1224] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:14:52.807848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba5a25-12d0-49a8-8827-46d31a0f5eeb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:52.922831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba5a25-12d0-49a8-8827-46d31a0f5eeb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:52.961182 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66345f63-7934-4494-96bc-09c9b3c2f24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:52.961902 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66345f63-7934-4494-96bc-09c9b3c2f24c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:52.962260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66345f63-7934-4494-96bc-09c9b3c2f24c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:52.962714 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66345f63-7934-4494-96bc-09c9b3c2f24c None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:52.963542 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66345f63-7934-4494-96bc-09c9b3c2f24c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:14:52.963847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66345f63-7934-4494-96bc-09c9b3c2f24c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:52.965736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66345f63-7934-4494-96bc-09c9b3c2f24c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:52.979372 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 608/1225] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:14:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:14:52.985146 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc091fc-7eec-454d-9f45-777e4b8e290d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:53.090046 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:53.097639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc091fc-7eec-454d-9f45-777e4b8e290d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:53.136550 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f3540-9ddd-4e19-b4af-9f2af4e218cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:53.137227 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f3540-9ddd-4e19-b4af-9f2af4e218cd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:53.137507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f3540-9ddd-4e19-b4af-9f2af4e218cd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:53.137784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f3540-9ddd-4e19-b4af-9f2af4e218cd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:53.146205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f3540-9ddd-4e19-b4af-9f2af4e218cd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:53.147497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f3540-9ddd-4e19-b4af-9f2af4e218cd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:53.160617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-8a8f3540-9ddd-4e19-b4af-9f2af4e218cd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:14:53.160617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:14:53.160617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:14:53.160617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:14:53.160617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:14:53.160617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:14:53.160617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:14:53.160617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:14:53.160617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:14:53.160617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:14:53.160617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:14:53.160617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:14:53.160617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:14:53.160617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:14:53.160617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:14:53.160617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:14:53.161854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:14:53.161854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:14:53.161854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:14:53.161854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:14:53.161854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:14:53.161854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:14:53.161854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:14:53.161854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:14:53.161854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:14:53.161854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:14:53.161854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:14:53.161854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:14:53.161854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:14:53.161854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:14:53.161854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:14:53.161854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:14:53.161854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:14:53.161854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:14:53.163004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:14:53.163004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:14:53.163004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:14:53.163004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:14:53.163004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:14:53.163004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:14:53.163004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:14:53.163004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:14:53.163004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:14:53.163004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:14:53.163004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 618/1226] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:14:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:14:53.167782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66345f63-7934-4494-96bc-09c9b3c2f24c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:53.220808 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:53.284487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66345f63-7934-4494-96bc-09c9b3c2f24c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:53.324777 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b1465-944f-4276-a9cb-a650fd063073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:53.325395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b1465-944f-4276-a9cb-a650fd063073 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:53.325671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b1465-944f-4276-a9cb-a650fd063073 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:53.325940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b1465-944f-4276-a9cb-a650fd063073 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:53.326687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b1465-944f-4276-a9cb-a650fd063073 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:14:53.326999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b1465-944f-4276-a9cb-a650fd063073 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:53.328439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b1465-944f-4276-a9cb-a650fd063073 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:53.347446 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 609/1227] 10.222.0.107 () {56 vars in 1148 bytes} [Tue Aug 23 23:14:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:14:53.353817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f3540-9ddd-4e19-b4af-9f2af4e218cd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:53.473845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f3540-9ddd-4e19-b4af-9f2af4e218cd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:53.512393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff3fac-1e52-4d02-b89f-b422f3bddc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:53.513151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff3fac-1e52-4d02-b89f-b422f3bddc7d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:53.513426 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff3fac-1e52-4d02-b89f-b422f3bddc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:53.513691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff3fac-1e52-4d02-b89f-b422f3bddc7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:53.526207 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff3fac-1e52-4d02-b89f-b422f3bddc7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:53.527785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff3fac-1e52-4d02-b89f-b422f3bddc7d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:53.543750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-c2ff3fac-1e52-4d02-b89f-b422f3bddc7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:14:53.543750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:14:53.543750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:14:53.543750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:14:53.543750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:14:53.543750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:14:53.543750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:14:53.543750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:14:53.543750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:14:53.543750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:14:53.543750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:14:53.543750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:14:53.543750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:14:53.543750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:14:53.543750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:14:53.543750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:14:53.544765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:14:53.544765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:14:53.544765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:14:53.544765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:14:53.544765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:14:53.544765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:14:53.544765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:14:53.544765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:14:53.544765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:14:53.544765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:14:53.544765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:14:53.544765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:14:53.544765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:14:53.544765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:14:53.544765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:14:53.544765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:14:53.544765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:14:53.545718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:14:53.545718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:14:53.545718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:14:53.545718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 619/1228] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:14:53.551233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b1465-944f-4276-a9cb-a650fd063073 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:53.662685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b1465-944f-4276-a9cb-a650fd063073 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:53.666125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:53.702918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644494c4-c031-421c-92d3-c67c60b42f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:53.703523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644494c4-c031-421c-92d3-c67c60b42f58 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:53.703798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644494c4-c031-421c-92d3-c67c60b42f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:53.704067 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644494c4-c031-421c-92d3-c67c60b42f58 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:53.704821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644494c4-c031-421c-92d3-c67c60b42f58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:14:53.705128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644494c4-c031-421c-92d3-c67c60b42f58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:53.706504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644494c4-c031-421c-92d3-c67c60b42f58 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:53.722260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 610/1229] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:14:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:14:53.728964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff3fac-1e52-4d02-b89f-b422f3bddc7d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:53.738823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:53.847503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff3fac-1e52-4d02-b89f-b422f3bddc7d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:53.891292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600837f8-580f-4f42-ad43-8382c3d12d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:53.891950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600837f8-580f-4f42-ad43-8382c3d12d8b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:53.892219 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600837f8-580f-4f42-ad43-8382c3d12d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:53.892490 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600837f8-580f-4f42-ad43-8382c3d12d8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:53.900171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600837f8-580f-4f42-ad43-8382c3d12d8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:53.901644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600837f8-580f-4f42-ad43-8382c3d12d8b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:53.915084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-600837f8-580f-4f42-ad43-8382c3d12d8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:14:53.915084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:14:53.915084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:14:53.915084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:14:53.915084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:14:53.915084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:14:53.915084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:14:53.915084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:14:53.915084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:14:53.915084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:14:53.915084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:14:53.915084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:14:53.915084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:14:53.915084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:14:53.915084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:14:53.916549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:14:53.916549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:14:53.916549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:14:53.916549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:14:53.916549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:14:53.916549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:14:53.916549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:14:53.916549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:14:53.916549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:14:53.916549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:14:53.916549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:14:53.916549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:14:53.916549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:14:53.916549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:14:53.916549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:14:53.916549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:14:53.916549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:14:53.917736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:14:53.917736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:14:53.917736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:14:53.917736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:14:53.917736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:14:53.917736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:14:53.917736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:14:53.917736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:14:53.921752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 620/1230] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:14:53.923018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644494c4-c031-421c-92d3-c67c60b42f58 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:54.041315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644494c4-c031-421c-92d3-c67c60b42f58 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:54.080268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bf443-9fd9-4b40-a948-673b83dc9b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:54.081085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bf443-9fd9-4b40-a948-673b83dc9b0a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:54.081448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bf443-9fd9-4b40-a948-673b83dc9b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:54.081729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bf443-9fd9-4b40-a948-673b83dc9b0a None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:54.082426 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bf443-9fd9-4b40-a948-673b83dc9b0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:14:54.082733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bf443-9fd9-4b40-a948-673b83dc9b0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:54.084170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bf443-9fd9-4b40-a948-673b83dc9b0a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:54.097802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 611/1231] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:14:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:14:54.103850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600837f8-580f-4f42-ad43-8382c3d12d8b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:54.180204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:54.221381 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600837f8-580f-4f42-ad43-8382c3d12d8b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:54.260268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b75742-c485-4d0c-8818-6a77b48304e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:54.260860 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b75742-c485-4d0c-8818-6a77b48304e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:54.261138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b75742-c485-4d0c-8818-6a77b48304e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:54.261410 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b75742-c485-4d0c-8818-6a77b48304e6 None admin] PATH_INFO: `/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/14ee6ffc0985405193735af49a398326/roles/ee7f9512e7e745199ff5ed847343d11a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:54.277894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b75742-c485-4d0c-8818-6a77b48304e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7cdd07c79614516be35aa2d82ec6a3b, user_id=14ee6ffc0985405193735af49a398326, role_id=ee7f9512e7e745199ff5ed847343d11a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:54.279536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b75742-c485-4d0c-8818-6a77b48304e6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:54.294488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 621/1232] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:14:54 2022] PUT /identity/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/14ee6ffc0985405193735af49a398326/roles/ee7f9512e7e745199ff5ed847343d11a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:14:56.271925 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cafa32-51c4-45b3-84d4-8e2e1b31215d None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:56.272447 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cafa32-51c4-45b3-84d4-8e2e1b31215d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:56.272447 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cafa32-51c4-45b3-84d4-8e2e1b31215d None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:56.274318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 612/1233] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:14:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:14:56.279764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674df51-ff7e-47c2-beb5-e6625c1167b7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:56.280170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674df51-ff7e-47c2-beb5-e6625c1167b7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:56.280304 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674df51-ff7e-47c2-beb5-e6625c1167b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:56.299856 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f674df51-ff7e-47c2-beb5-e6625c1167b7 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:56.301093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f674df51-ff7e-47c2-beb5-e6625c1167b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:56.378871 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 622/1234] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:14:56 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:14:56.669893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cafa32-51c4-45b3-84d4-8e2e1b31215d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:56.697372 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:56.786253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cafa32-51c4-45b3-84d4-8e2e1b31215d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:56.824544 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf120beb-68e6-45dd-8160-96e0775cc485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:56.825285 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf120beb-68e6-45dd-8160-96e0775cc485 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:56.825588 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf120beb-68e6-45dd-8160-96e0775cc485 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:56.825866 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf120beb-68e6-45dd-8160-96e0775cc485 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:56.837722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf120beb-68e6-45dd-8160-96e0775cc485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:14:56.842602 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-bf120beb-68e6-45dd-8160-96e0775cc485 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:14:56.842602 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:14:56.842602 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:14:56.842602 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:14:56.842602 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:14:56.842602 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:14:56.842602 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:14:56.842602 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:14:56.842602 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:14:56.842602 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:14:56.842602 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:14:56.842602 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:14:56.842602 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:14:56.842602 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:14:56.842602 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:14:56.842602 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:14:56.843762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:14:56.843762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:14:56.843762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:14:56.843762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:14:56.843762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:14:56.843762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:14:56.843762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:14:56.843762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:14:56.843762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:14:56.843762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:14:56.843762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:14:56.843762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:14:56.843762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:14:56.843762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:14:56.843762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:14:56.843762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:14:56.844744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:14:56.844744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:14:56.844744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:14:56.844744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:14:56.844744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:14:56.844744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:14:56.844744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:14:56.844744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:14:56.844744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:14:56.844744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:14:56.844744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:14:56.844744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:14:56.844744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 613/1235] 10.222.0.107 () {56 vars in 1107 bytes} [Tue Aug 23 23:14:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:14:56.850369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674df51-ff7e-47c2-beb5-e6625c1167b7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:56.903122 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:56.964441 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674df51-ff7e-47c2-beb5-e6625c1167b7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:57.006809 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c484c9-4f95-4124-b88e-65a7a90add00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:57.007470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c484c9-4f95-4124-b88e-65a7a90add00 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:57.007886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c484c9-4f95-4124-b88e-65a7a90add00 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:57.008163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c484c9-4f95-4124-b88e-65a7a90add00 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:57.008881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c484c9-4f95-4124-b88e-65a7a90add00 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:14:57.009952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c484c9-4f95-4124-b88e-65a7a90add00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:57.010804 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c484c9-4f95-4124-b88e-65a7a90add00 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:57.019929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 623/1236] 10.222.0.107 () {56 vars in 1108 bytes} [Tue Aug 23 23:14:56 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:14:57.026576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf120beb-68e6-45dd-8160-96e0775cc485 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:57.120853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:57.138656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf120beb-68e6-45dd-8160-96e0775cc485 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:57.177084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe5ad8-2d58-4cac-b859-696936840691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:57.177718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe5ad8-2d58-4cac-b859-696936840691 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:57.177997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe5ad8-2d58-4cac-b859-696936840691 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:57.178268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe5ad8-2d58-4cac-b859-696936840691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:57.188723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe5ad8-2d58-4cac-b859-696936840691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:57.190181 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe5ad8-2d58-4cac-b859-696936840691 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:57.205655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c8fe5ad8-2d58-4cac-b859-696936840691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:14:57.205655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:14:57.205655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:14:57.205655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:14:57.205655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:14:57.205655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:14:57.205655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:14:57.205655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:14:57.205655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:14:57.205655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:14:57.205655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:14:57.205655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:14:57.205655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:14:57.205655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:14:57.205655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:14:57.205655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:14:57.207170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:14:57.207170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:14:57.207170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:14:57.207170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:14:57.207170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:14:57.207170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:14:57.207170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:14:57.207170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:14:57.207170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:14:57.207170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:14:57.207170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:14:57.207170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:14:57.207170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:14:57.207170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:14:57.207170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:14:57.207170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:14:57.207170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:14:57.208375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:14:57.208375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:14:57.208375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:14:57.208375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 614/1237] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:14:57.213921 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c484c9-4f95-4124-b88e-65a7a90add00 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:57.333194 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c484c9-4f95-4124-b88e-65a7a90add00 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:57.344195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:57.375055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629ca2b-cd89-438e-b79c-aef0e74b02ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:57.375667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629ca2b-cd89-438e-b79c-aef0e74b02ec None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:57.376038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629ca2b-cd89-438e-b79c-aef0e74b02ec None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:57.376229 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629ca2b-cd89-438e-b79c-aef0e74b02ec None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:57.377008 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629ca2b-cd89-438e-b79c-aef0e74b02ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:14:57.377235 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629ca2b-cd89-438e-b79c-aef0e74b02ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:57.378542 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629ca2b-cd89-438e-b79c-aef0e74b02ec None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:57.396847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 624/1238] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:14:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:14:57.398865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe5ad8-2d58-4cac-b859-696936840691 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:57.509928 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe5ad8-2d58-4cac-b859-696936840691 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:57.547402 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6941f-e89c-4fbd-8982-5855d83963b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:57.548044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6941f-e89c-4fbd-8982-5855d83963b8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:57.548327 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6941f-e89c-4fbd-8982-5855d83963b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:57.548632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6941f-e89c-4fbd-8982-5855d83963b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:57.551752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:57.557886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6941f-e89c-4fbd-8982-5855d83963b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:57.559576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6941f-e89c-4fbd-8982-5855d83963b8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:57.571867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f4b6941f-e89c-4fbd-8982-5855d83963b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:14:57.571867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:14:57.571867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:14:57.571867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:14:57.571867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:14:57.571867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:14:57.571867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:14:57.571867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:14:57.571867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:14:57.571867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:14:57.571867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:14:57.571867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:14:57.571867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:14:57.571867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:14:57.571867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:14:57.571867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:14:57.573173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:14:57.573173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:14:57.573173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:14:57.573173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:14:57.573173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:14:57.573173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:14:57.573173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:14:57.573173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:14:57.573173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:14:57.573173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:14:57.573173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:14:57.573173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:14:57.573173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:14:57.573173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:14:57.573173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:14:57.573173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:14:57.573173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:14:57.573173 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:14:57.574184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:14:57.574184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:14:57.574184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:14:57.574184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:14:57.574184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:14:57.574184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:14:57.574184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:14:57.574184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:14:57.574184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:14:57.574184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:14:57.574184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 615/1239] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:14:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:14:57.579772 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629ca2b-cd89-438e-b79c-aef0e74b02ec None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:57.690757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629ca2b-cd89-438e-b79c-aef0e74b02ec None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:57.728329 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37be3f-8d9c-4659-a37a-f4c6dadd97ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:57.728979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37be3f-8d9c-4659-a37a-f4c6dadd97ac None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:57.729260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37be3f-8d9c-4659-a37a-f4c6dadd97ac None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:57.729533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37be3f-8d9c-4659-a37a-f4c6dadd97ac None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:57.730266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37be3f-8d9c-4659-a37a-f4c6dadd97ac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:14:57.730572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37be3f-8d9c-4659-a37a-f4c6dadd97ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:57.731992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37be3f-8d9c-4659-a37a-f4c6dadd97ac None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:57.758961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 625/1240] 10.222.0.107 () {56 vars in 1148 bytes} [Tue Aug 23 23:14:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:14:57.765178 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6941f-e89c-4fbd-8982-5855d83963b8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:57.878081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6941f-e89c-4fbd-8982-5855d83963b8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:57.921011 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03939f21-e612-4abc-ad94-adb14ac78560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:57.921818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03939f21-e612-4abc-ad94-adb14ac78560 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:57.922133 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03939f21-e612-4abc-ad94-adb14ac78560 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:57.922489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03939f21-e612-4abc-ad94-adb14ac78560 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:58.004564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:58.013829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03939f21-e612-4abc-ad94-adb14ac78560 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:58.015292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03939f21-e612-4abc-ad94-adb14ac78560 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:58.122845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 616/1241] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:14:57 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:14:58.128823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37be3f-8d9c-4659-a37a-f4c6dadd97ac None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:58.159075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:58.247013 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37be3f-8d9c-4659-a37a-f4c6dadd97ac None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:58.287241 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c913a-aa30-41af-88fc-c20d7b0c68a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:58.287882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c913a-aa30-41af-88fc-c20d7b0c68a8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:58.288162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c913a-aa30-41af-88fc-c20d7b0c68a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:58.288433 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c913a-aa30-41af-88fc-c20d7b0c68a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:58.300477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c913a-aa30-41af-88fc-c20d7b0c68a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:58.301835 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c913a-aa30-41af-88fc-c20d7b0c68a8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:58.319307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-c04c913a-aa30-41af-88fc-c20d7b0c68a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:14:58.319307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:14:58.319307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:14:58.319307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:14:58.319307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:14:58.319307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:14:58.319307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:14:58.319307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:14:58.319307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:14:58.319307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:14:58.319307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:14:58.319307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:14:58.319307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:14:58.319307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:14:58.319307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:14:58.319307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:14:58.321030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:14:58.321030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:14:58.321030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:14:58.321030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:14:58.321030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:14:58.321030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:14:58.321030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:14:58.321030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:14:58.321030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:14:58.321030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:14:58.321030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:14:58.321030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:14:58.321030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:14:58.321030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:14:58.321030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:14:58.321030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:14:58.321030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:14:58.322362 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:14:58.322362 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:14:58.322362 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:14:58.322362 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 626/1242] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:14:58.326414 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03939f21-e612-4abc-ad94-adb14ac78560 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:58.433856 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:58.440378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03939f21-e612-4abc-ad94-adb14ac78560 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:58.480627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8f589-b03a-40fd-a79a-211d052e39db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:58.481319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8f589-b03a-40fd-a79a-211d052e39db None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:58.481690 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8f589-b03a-40fd-a79a-211d052e39db None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:58.482018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8f589-b03a-40fd-a79a-211d052e39db None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:58.482737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8f589-b03a-40fd-a79a-211d052e39db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:14:58.483040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8f589-b03a-40fd-a79a-211d052e39db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:58.484569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8f589-b03a-40fd-a79a-211d052e39db None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:58.497753 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 617/1243] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:14:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:14:58.503347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c913a-aa30-41af-88fc-c20d7b0c68a8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:58.594119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:58.620440 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c913a-aa30-41af-88fc-c20d7b0c68a8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:58.657634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffed74-0d02-437b-92c4-eff814a24977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:58.658267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffed74-0d02-437b-92c4-eff814a24977 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:58.658546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffed74-0d02-437b-92c4-eff814a24977 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:58.658818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffed74-0d02-437b-92c4-eff814a24977 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:58.666317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ffed74-0d02-437b-92c4-eff814a24977 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:58.667761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ffed74-0d02-437b-92c4-eff814a24977 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:58.681837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-b5ffed74-0d02-437b-92c4-eff814a24977 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:14:58.681837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:14:58.681837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:14:58.681837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:14:58.681837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:14:58.681837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:14:58.681837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:14:58.681837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:14:58.681837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:14:58.681837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:14:58.681837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:14:58.681837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:14:58.681837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:14:58.681837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:14:58.681837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:14:58.683042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:14:58.683042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:14:58.683042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:14:58.683042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:14:58.683042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:14:58.683042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:14:58.683042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:14:58.683042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:14:58.683042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:14:58.683042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:14:58.683042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:14:58.683042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:14:58.683042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:14:58.683042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:14:58.683042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:14:58.683042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:14:58.683042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:14:58.684096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:14:58.684096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:14:58.684096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:14:58.684096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:14:58.684096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:14:58.684096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:14:58.684096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:14:58.684096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:14:58.684096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 627/1244] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:14:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:14:58.689729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8f589-b03a-40fd-a79a-211d052e39db None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:58.810783 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8f589-b03a-40fd-a79a-211d052e39db None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:58.850861 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede01476-fc37-41a6-b9c1-4ba21f7bf7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:58.851686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede01476-fc37-41a6-b9c1-4ba21f7bf7fb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:58.852147 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede01476-fc37-41a6-b9c1-4ba21f7bf7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:58.852470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede01476-fc37-41a6-b9c1-4ba21f7bf7fb None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:58.853303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede01476-fc37-41a6-b9c1-4ba21f7bf7fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:14:58.853590 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede01476-fc37-41a6-b9c1-4ba21f7bf7fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:58.855019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede01476-fc37-41a6-b9c1-4ba21f7bf7fb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:58.868405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 618/1245] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:14:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:14:58.874913 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffed74-0d02-437b-92c4-eff814a24977 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:58.983202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffed74-0d02-437b-92c4-eff814a24977 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:59.022957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671ebd1-2439-4156-8e6b-c88796dbd112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:59.023846 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671ebd1-2439-4156-8e6b-c88796dbd112 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:59.024252 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671ebd1-2439-4156-8e6b-c88796dbd112 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:59.024568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671ebd1-2439-4156-8e6b-c88796dbd112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:59.025339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671ebd1-2439-4156-8e6b-c88796dbd112 None admin] RBAC: Adding query filter params (role.id=ee7f9512e7e745199ff5ed847343d11a, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=14ee6ffc0985405193735af49a398326) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:14:59.025643 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671ebd1-2439-4156-8e6b-c88796dbd112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:59.027088 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671ebd1-2439-4156-8e6b-c88796dbd112 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:59.033563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 628/1246] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:14:58 2022] GET /identity/v3/role_assignments?user.id=14ee6ffc0985405193735af49a398326&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=ee7f9512e7e745199ff5ed847343d11a => generated 610 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:01.074791 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4571e-2df9-474c-a9cf-4e2ea31778e4 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:01.075351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4571e-2df9-474c-a9cf-4e2ea31778e4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:01.075351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4571e-2df9-474c-a9cf-4e2ea31778e4 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:01.076681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 619/1247] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:15:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:15:01.082125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5dc0c-5255-4288-92a2-000c009605a0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:01.082633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5dc0c-5255-4288-92a2-000c009605a0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:01.082741 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5dc0c-5255-4288-92a2-000c009605a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:01.089264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:01.103617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cfe5dc0c-5255-4288-92a2-000c009605a0 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:01.105054 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cfe5dc0c-5255-4288-92a2-000c009605a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:01.183926 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 629/1248] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:15:01 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:15:01.460553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4571e-2df9-474c-a9cf-4e2ea31778e4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:01.481960 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:01.593654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4571e-2df9-474c-a9cf-4e2ea31778e4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:01.635264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bf736-11ce-4883-a5c6-b9a65a843620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:01.635905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bf736-11ce-4883-a5c6-b9a65a843620 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:01.636180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bf736-11ce-4883-a5c6-b9a65a843620 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:01.636452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bf736-11ce-4883-a5c6-b9a65a843620 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:01.648884 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34bf736-11ce-4883-a5c6-b9a65a843620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:15:01.654167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b34bf736-11ce-4883-a5c6-b9a65a843620 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:15:01.654167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:01.654167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:01.654167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:01.654167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:01.654167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:01.654167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:01.654167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:01.654167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:01.654167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:01.654167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:01.654167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:01.654167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:15:01.654167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:15:01.654167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:15:01.654167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:15:01.655452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:15:01.655452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:15:01.655452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:15:01.655452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:15:01.655452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:01.655452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:01.655452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:01.655452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:01.655452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:01.655452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:01.655452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:01.655452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:01.655452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:01.655452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:01.655452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:01.655452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:01.656525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:01.656525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:01.656525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:01.656525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:01.656525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:15:01.656525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:15:01.656525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:15:01.656525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:15:01.656525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:15:01.656525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:15:01.656525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:15:01.656525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:15:01.656525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 620/1249] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:15:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:01.661913 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5dc0c-5255-4288-92a2-000c009605a0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:01.770171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5dc0c-5255-4288-92a2-000c009605a0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:01.803484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:01.808937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b91033-7922-4409-adac-b5e411f04a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:01.809686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b91033-7922-4409-adac-b5e411f04a11 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:01.809964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b91033-7922-4409-adac-b5e411f04a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:01.810240 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b91033-7922-4409-adac-b5e411f04a11 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:01.810928 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b91033-7922-4409-adac-b5e411f04a11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:01.811219 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b91033-7922-4409-adac-b5e411f04a11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:01.812583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b91033-7922-4409-adac-b5e411f04a11 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:01.821997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 630/1250] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:15:01 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:01.827737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bf736-11ce-4883-a5c6-b9a65a843620 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:01.919530 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:01.948102 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bf736-11ce-4883-a5c6-b9a65a843620 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:01.987785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6838d5d-74b1-4b45-9279-da69d85c7440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:01.988418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6838d5d-74b1-4b45-9279-da69d85c7440 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:01.988728 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6838d5d-74b1-4b45-9279-da69d85c7440 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:01.989002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6838d5d-74b1-4b45-9279-da69d85c7440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:02.001019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6838d5d-74b1-4b45-9279-da69d85c7440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:02.002491 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6838d5d-74b1-4b45-9279-da69d85c7440 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:02.029002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e6838d5d-74b1-4b45-9279-da69d85c7440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:02.029002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:02.029002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:02.029002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:02.029002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:02.029002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:02.029002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:02.029002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:02.029002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:02.029002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:02.029002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:02.029002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:02.029002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:02.029002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:02.029002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:02.029002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:02.030435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:02.030435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:02.030435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:02.030435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:02.030435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:02.030435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:02.030435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:02.030435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:02.030435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:02.030435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:02.030435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:02.030435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:02.030435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:02.030435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:02.030435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:02.030435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:02.030435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:02.031568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:02.031568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:02.031568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:15:02.031568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 621/1251] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:02.039177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b91033-7922-4409-adac-b5e411f04a11 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:02.174057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b91033-7922-4409-adac-b5e411f04a11 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:02.271890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20b722-e062-4741-aac2-415e4197f8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:02.272512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20b722-e062-4741-aac2-415e4197f8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:02.272826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20b722-e062-4741-aac2-415e4197f8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:02.273570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20b722-e062-4741-aac2-415e4197f8f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:02.274380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20b722-e062-4741-aac2-415e4197f8f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:02.274521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20b722-e062-4741-aac2-415e4197f8f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:02.275987 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20b722-e062-4741-aac2-415e4197f8f3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:02.291457 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 631/1252] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:15:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:15:02.298040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6838d5d-74b1-4b45-9279-da69d85c7440 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:02.418776 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6838d5d-74b1-4b45-9279-da69d85c7440 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:02.448365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:02.458649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c513fad-e453-451d-813a-824866a19add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:02.459328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c513fad-e453-451d-813a-824866a19add None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:02.459603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c513fad-e453-451d-813a-824866a19add None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:02.459876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c513fad-e453-451d-813a-824866a19add None admin] PATH_INFO: `/v3/users/placement` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:02.468588 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c513fad-e453-451d-813a-824866a19add None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:02.470142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c513fad-e453-451d-813a-824866a19add None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:02.484158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-6c513fad-e453-451d-813a-824866a19add None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:15:02.484158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:02.484158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:02.484158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:02.484158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:02.484158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:02.484158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:02.484158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:02.484158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:02.484158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:02.484158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:02.484158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:02.484158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:15:02.484158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:15:02.484158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:15:02.484158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:15:02.485493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:02.485493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:02.485493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:15:02.485493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:15:02.485493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:15:02.485493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:15:02.485493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:02.485493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:02.485493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:02.485493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:02.485493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:02.485493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:02.485493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:02.485493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:02.485493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:02.485493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:02.485493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:02.485493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:02.486665 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:02.486665 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:02.486665 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:15:02.486665 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:15:02.486665 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:15:02.486665 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:15:02.486665 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:15:02.486665 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:15:02.486665 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:15:02.486665 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:15:02.486665 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 622/1253] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:15:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:02.493772 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20b722-e062-4741-aac2-415e4197f8f3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:02.568026 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:02.618214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20b722-e062-4741-aac2-415e4197f8f3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:02.654513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bb1b4-01fa-499a-a36e-a75c29f63572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:02.655132 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bb1b4-01fa-499a-a36e-a75c29f63572 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:02.655406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bb1b4-01fa-499a-a36e-a75c29f63572 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:02.655676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bb1b4-01fa-499a-a36e-a75c29f63572 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:02.656400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5bb1b4-01fa-499a-a36e-a75c29f63572 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:02.656736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5bb1b4-01fa-499a-a36e-a75c29f63572 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:02.658161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5bb1b4-01fa-499a-a36e-a75c29f63572 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:02.676530 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 632/1254] 10.222.0.107 () {56 vars in 1148 bytes} [Tue Aug 23 23:15:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:15:02.683539 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c513fad-e453-451d-813a-824866a19add None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:02.803562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c513fad-e453-451d-813a-824866a19add None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:02.843022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b63e2f-8d05-494d-9a91-f2d4735813d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:02.843523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b63e2f-8d05-494d-9a91-f2d4735813d2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:02.843888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b63e2f-8d05-494d-9a91-f2d4735813d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:02.844069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b63e2f-8d05-494d-9a91-f2d4735813d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:02.913302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:02.930226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b63e2f-8d05-494d-9a91-f2d4735813d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:02.931795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b63e2f-8d05-494d-9a91-f2d4735813d2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:03.059308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 623/1255] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:15:02 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:15:03.065236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bb1b4-01fa-499a-a36e-a75c29f63572 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:03.179109 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bb1b4-01fa-499a-a36e-a75c29f63572 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:03.194788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:03.223317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50ae6b-a4fe-474b-9739-b98331bec9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:03.223967 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50ae6b-a4fe-474b-9739-b98331bec9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:03.224243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50ae6b-a4fe-474b-9739-b98331bec9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:03.224509 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50ae6b-a4fe-474b-9739-b98331bec9a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:03.236130 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50ae6b-a4fe-474b-9739-b98331bec9a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:03.237697 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50ae6b-a4fe-474b-9739-b98331bec9a1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:03.256981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-6f50ae6b-a4fe-474b-9739-b98331bec9a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:03.256981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:03.256981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:03.256981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:03.256981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:03.256981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:03.256981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:03.256981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:03.256981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:03.256981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:03.256981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:03.256981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:03.256981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:03.256981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:03.256981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:03.256981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:03.259334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:03.259334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:03.259334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:03.259334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:03.259334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:03.259334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:03.259334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:03.259334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:03.259334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:03.259334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:03.259334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:03.259334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:03.259334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:03.259334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:03.259334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:03.259334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:03.259334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:03.260900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:03.260900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:03.260900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:15:03.260900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 633/1256] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:03.264988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b63e2f-8d05-494d-9a91-f2d4735813d2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:03.367391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:03.380163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b63e2f-8d05-494d-9a91-f2d4735813d2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:03.416137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6abb53-79b4-41ca-9c4d-cb17e4577ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:03.416919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6abb53-79b4-41ca-9c4d-cb17e4577ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:03.417036 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6abb53-79b4-41ca-9c4d-cb17e4577ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:03.417312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6abb53-79b4-41ca-9c4d-cb17e4577ee5 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:03.417948 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6abb53-79b4-41ca-9c4d-cb17e4577ee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:03.418246 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6abb53-79b4-41ca-9c4d-cb17e4577ee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:03.419609 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6abb53-79b4-41ca-9c4d-cb17e4577ee5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:03.433159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 624/1257] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:15:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:03.438953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50ae6b-a4fe-474b-9739-b98331bec9a1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:03.555096 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50ae6b-a4fe-474b-9739-b98331bec9a1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:03.592832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745f24a-87c9-4519-b612-f7c9311f486a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:03.593571 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745f24a-87c9-4519-b612-f7c9311f486a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:03.593863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745f24a-87c9-4519-b612-f7c9311f486a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:03.594122 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745f24a-87c9-4519-b612-f7c9311f486a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:03.602972 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745f24a-87c9-4519-b612-f7c9311f486a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:03.604529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745f24a-87c9-4519-b612-f7c9311f486a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:03.616868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-7745f24a-87c9-4519-b612-f7c9311f486a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:15:03.616868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:03.616868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:03.616868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:03.616868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:03.616868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:03.616868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:03.616868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:03.616868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:03.616868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:03.616868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:03.616868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:03.616868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:15:03.616868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:15:03.616868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:15:03.618696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:15:03.618696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:03.618696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:03.618696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:03.618696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:03.618696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:03.618696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:03.618696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:03.618696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:03.618696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:03.618696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:03.618696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:03.618696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:03.618696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:03.618696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:03.618696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:03.618696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:03.619603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:15:03.619603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:15:03.619603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:15:03.619603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:15:03.619603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:15:03.619603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:15:03.619603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:15:03.619603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:15:03.619603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 634/1258] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:15:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:03.624885 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6abb53-79b4-41ca-9c4d-cb17e4577ee5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:03.736541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6abb53-79b4-41ca-9c4d-cb17e4577ee5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:03.774510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf2de1-c10c-49c7-9333-4712b34a9dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:03.775155 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf2de1-c10c-49c7-9333-4712b34a9dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:03.775426 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf2de1-c10c-49c7-9333-4712b34a9dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:03.775775 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf2de1-c10c-49c7-9333-4712b34a9dd6 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:03.776518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf2de1-c10c-49c7-9333-4712b34a9dd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:03.776870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf2de1-c10c-49c7-9333-4712b34a9dd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:03.778464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf2de1-c10c-49c7-9333-4712b34a9dd6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:03.792630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 625/1259] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:15:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:03.798779 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745f24a-87c9-4519-b612-f7c9311f486a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:03.828750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:03.912991 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745f24a-87c9-4519-b612-f7c9311f486a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:03.955804 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff03d4-278f-4ab2-8e1b-6337f1221897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:03.956410 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff03d4-278f-4ab2-8e1b-6337f1221897 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:03.956720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff03d4-278f-4ab2-8e1b-6337f1221897 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:03.956990 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff03d4-278f-4ab2-8e1b-6337f1221897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:03.957721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff03d4-278f-4ab2-8e1b-6337f1221897 None admin] RBAC: Adding query filter params (role.id=97ece22f2e264e0e857d5107325a85d9, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=14ee6ffc0985405193735af49a398326) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:03.958027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff03d4-278f-4ab2-8e1b-6337f1221897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:03.959569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff03d4-278f-4ab2-8e1b-6337f1221897 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:03.966255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 635/1260] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:15:03 2022] GET /identity/v3/role_assignments?user.id=14ee6ffc0985405193735af49a398326&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:05.912204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a1600-07bb-45d7-992c-015f0199ce65 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:05.912791 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a1600-07bb-45d7-992c-015f0199ce65 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:05.912791 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a1600-07bb-45d7-992c-015f0199ce65 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:05.914701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 626/1261] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:15:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:15:05.919810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fab475-e1ab-4a57-9ef4-bbba1088624b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:05.920255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fab475-e1ab-4a57-9ef4-bbba1088624b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:05.920359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fab475-e1ab-4a57-9ef4-bbba1088624b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:05.939256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-74fab475-e1ab-4a57-9ef4-bbba1088624b None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:05.940437 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-74fab475-e1ab-4a57-9ef4-bbba1088624b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:06.005196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 636/1262] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:15:05 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:15:06.278276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a1600-07bb-45d7-992c-015f0199ce65 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:06.289732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:06.390231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a1600-07bb-45d7-992c-015f0199ce65 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:06.423561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43c366-4fcf-4d4d-bc4f-d3e59a9b130b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:06.424257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43c366-4fcf-4d4d-bc4f-d3e59a9b130b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:06.424455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43c366-4fcf-4d4d-bc4f-d3e59a9b130b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:06.425007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43c366-4fcf-4d4d-bc4f-d3e59a9b130b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:06.435722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43c366-4fcf-4d4d-bc4f-d3e59a9b130b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:15:06.440460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-5b43c366-4fcf-4d4d-bc4f-d3e59a9b130b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:15:06.440460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:06.440460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:06.440460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:06.440460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:06.440460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:06.440460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:06.440460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:06.440460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:06.440460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:06.440460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:06.440460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:06.440460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:15:06.440460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:15:06.440460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:15:06.440460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:15:06.441582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:15:06.441582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:15:06.441582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:15:06.441582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:15:06.441582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:06.441582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:06.441582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:06.441582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:06.441582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:06.441582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:06.441582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:06.441582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:06.441582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:06.441582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:06.441582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:06.441582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:06.442489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:06.442489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:06.442489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:06.442489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:06.442489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:15:06.442489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:15:06.442489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:15:06.442489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:15:06.442489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:15:06.442489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:15:06.442489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:15:06.442489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:15:06.442489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 627/1263] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:15:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:06.447635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fab475-e1ab-4a57-9ef4-bbba1088624b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:06.465575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:06.545067 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fab475-e1ab-4a57-9ef4-bbba1088624b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:06.579082 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872eba7-8e98-4dae-bd8a-6915bc1885c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:06.579685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872eba7-8e98-4dae-bd8a-6915bc1885c2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:06.579956 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872eba7-8e98-4dae-bd8a-6915bc1885c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:06.580225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872eba7-8e98-4dae-bd8a-6915bc1885c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:06.580917 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872eba7-8e98-4dae-bd8a-6915bc1885c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:06.581222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872eba7-8e98-4dae-bd8a-6915bc1885c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:06.582593 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872eba7-8e98-4dae-bd8a-6915bc1885c2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:06.591636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 637/1264] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:15:06 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:06.597414 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43c366-4fcf-4d4d-bc4f-d3e59a9b130b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:06.664197 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:06.697514 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43c366-4fcf-4d4d-bc4f-d3e59a9b130b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:06.730204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fdeb3-01d9-42b8-b53b-ee29f97071bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:06.730830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fdeb3-01d9-42b8-b53b-ee29f97071bb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:06.731109 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fdeb3-01d9-42b8-b53b-ee29f97071bb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:06.731383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fdeb3-01d9-42b8-b53b-ee29f97071bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:06.741226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fdeb3-01d9-42b8-b53b-ee29f97071bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:06.743324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fdeb3-01d9-42b8-b53b-ee29f97071bb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:06.758949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-709fdeb3-01d9-42b8-b53b-ee29f97071bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:06.758949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:06.758949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:06.758949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:06.758949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:06.758949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:06.758949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:06.758949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:06.758949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:06.758949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:06.758949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:06.758949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:06.758949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:06.758949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:06.758949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:06.758949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:06.760079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:06.760079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:06.760079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:06.760079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:06.760079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:06.760079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:06.760079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:06.760079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:06.760079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:06.760079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:06.760079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:06.760079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:06.760079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:06.760079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:06.760079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:06.760079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:06.760079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:06.761072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:06.761072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:06.761072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:15:06.761072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 628/1265] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:06.765853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872eba7-8e98-4dae-bd8a-6915bc1885c2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:06.844262 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:06.862643 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872eba7-8e98-4dae-bd8a-6915bc1885c2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:06.896090 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68775b7-a7b9-40ed-aef3-7ae61ab5e8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:06.896715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68775b7-a7b9-40ed-aef3-7ae61ab5e8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:06.896993 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68775b7-a7b9-40ed-aef3-7ae61ab5e8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:06.897264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68775b7-a7b9-40ed-aef3-7ae61ab5e8d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:06.897903 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68775b7-a7b9-40ed-aef3-7ae61ab5e8d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:06.898247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68775b7-a7b9-40ed-aef3-7ae61ab5e8d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:06.899612 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68775b7-a7b9-40ed-aef3-7ae61ab5e8d0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:06.911039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 638/1266] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:15:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:06.917101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fdeb3-01d9-42b8-b53b-ee29f97071bb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:07.020886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fdeb3-01d9-42b8-b53b-ee29f97071bb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:07.041334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:07.056791 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bdc8d-98db-4b08-b6a9-0fc1ec8e09c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:07.057491 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bdc8d-98db-4b08-b6a9-0fc1ec8e09c3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:07.057808 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bdc8d-98db-4b08-b6a9-0fc1ec8e09c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:07.058120 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bdc8d-98db-4b08-b6a9-0fc1ec8e09c3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:07.065673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50bdc8d-98db-4b08-b6a9-0fc1ec8e09c3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:07.067105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50bdc8d-98db-4b08-b6a9-0fc1ec8e09c3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:07.078507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b50bdc8d-98db-4b08-b6a9-0fc1ec8e09c3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:15:07.078507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:07.078507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:07.078507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:07.078507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:07.078507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:07.078507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:07.078507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:07.078507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:07.078507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:07.078507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:07.078507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:07.078507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:15:07.078507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:15:07.078507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:15:07.078507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:15:07.079673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:07.079673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:07.079673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:15:07.079673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:15:07.079673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:15:07.079673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:15:07.079673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:07.079673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:07.079673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:07.079673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:07.079673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:07.079673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:07.079673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:07.079673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:07.079673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:07.079673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:07.079673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:07.079673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:07.080831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:07.080831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:07.080831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:15:07.080831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:15:07.080831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:15:07.080831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:15:07.080831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:15:07.080831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:15:07.080831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:15:07.080831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:15:07.080831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 629/1267] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:15:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:07.085649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68775b7-a7b9-40ed-aef3-7ae61ab5e8d0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:07.184438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68775b7-a7b9-40ed-aef3-7ae61ab5e8d0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:07.216978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9d876-320c-40ad-b143-b830568620e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:07.217582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9d876-320c-40ad-b143-b830568620e4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:07.217859 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9d876-320c-40ad-b143-b830568620e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:07.218129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9d876-320c-40ad-b143-b830568620e4 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:07.218851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9d876-320c-40ad-b143-b830568620e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:07.219154 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9d876-320c-40ad-b143-b830568620e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:07.220568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9d876-320c-40ad-b143-b830568620e4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:07.230653 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:07.239302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 639/1268] 10.222.0.107 () {56 vars in 1148 bytes} [Tue Aug 23 23:15:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:07.245899 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bdc8d-98db-4b08-b6a9-0fc1ec8e09c3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:07.356958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bdc8d-98db-4b08-b6a9-0fc1ec8e09c3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:07.389950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da572aeb-2dcc-4e18-aa48-51405b96060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:07.390574 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da572aeb-2dcc-4e18-aa48-51405b96060c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:07.390855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da572aeb-2dcc-4e18-aa48-51405b96060c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:07.391129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da572aeb-2dcc-4e18-aa48-51405b96060c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:07.402357 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da572aeb-2dcc-4e18-aa48-51405b96060c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:07.403805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da572aeb-2dcc-4e18-aa48-51405b96060c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:07.418231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-da572aeb-2dcc-4e18-aa48-51405b96060c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:07.418231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:07.418231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:07.418231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:07.418231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:07.418231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:07.418231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:07.418231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:07.418231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:07.418231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:07.418231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:07.418231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:07.418231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:07.418231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:07.418231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:07.418231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:07.424112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:07.424112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:07.424112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:07.424112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:07.424112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:07.424112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:07.424112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:07.424112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:07.424112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:07.424112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:07.424112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:07.424112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:07.424112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:07.424112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:07.424112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:07.424112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:07.424112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:07.425575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:07.425575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:07.425575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:15:07.425575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 630/1269] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:07.425868 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9d876-320c-40ad-b143-b830568620e4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:07.522094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9d876-320c-40ad-b143-b830568620e4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:07.557180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865995c2-0ace-47f9-aa83-c04e38e6c2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:07.557778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865995c2-0ace-47f9-aa83-c04e38e6c2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:07.558081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865995c2-0ace-47f9-aa83-c04e38e6c2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:07.558350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865995c2-0ace-47f9-aa83-c04e38e6c2b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:07.559085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865995c2-0ace-47f9-aa83-c04e38e6c2b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:07.559291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865995c2-0ace-47f9-aa83-c04e38e6c2b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:07.560694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865995c2-0ace-47f9-aa83-c04e38e6c2b9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:07.572707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 640/1270] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:15:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:07.578531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da572aeb-2dcc-4e18-aa48-51405b96060c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:07.610484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:07.679174 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da572aeb-2dcc-4e18-aa48-51405b96060c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:07.711981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c266b5e-6144-4a8b-b3a6-b2b96abb91e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:07.712590 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c266b5e-6144-4a8b-b3a6-b2b96abb91e0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:07.712888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c266b5e-6144-4a8b-b3a6-b2b96abb91e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:07.713157 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c266b5e-6144-4a8b-b3a6-b2b96abb91e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:07.719589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c266b5e-6144-4a8b-b3a6-b2b96abb91e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:07.721059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c266b5e-6144-4a8b-b3a6-b2b96abb91e0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:07.732568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4c266b5e-6144-4a8b-b3a6-b2b96abb91e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:15:07.732568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:07.732568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:07.732568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:07.732568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:07.732568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:07.732568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:07.732568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:07.732568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:07.732568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:07.732568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:07.732568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:07.732568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:15:07.732568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:15:07.732568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:15:07.733640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:15:07.733640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:07.733640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:07.733640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:07.733640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:07.733640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:07.733640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:07.733640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:07.733640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:07.733640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:07.733640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:07.733640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:07.733640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:07.733640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:07.733640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:07.733640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:07.733640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:07.734561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:15:07.734561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:15:07.734561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:15:07.734561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:15:07.734561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:15:07.734561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:15:07.734561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:15:07.734561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:15:07.734561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 631/1271] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:15:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:07.739622 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865995c2-0ace-47f9-aa83-c04e38e6c2b9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:07.798408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:07.841407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865995c2-0ace-47f9-aa83-c04e38e6c2b9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:07.873737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ff44b-f68f-40c6-8f59-f546fbaa27a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:07.874330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ff44b-f68f-40c6-8f59-f546fbaa27a5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:07.874605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ff44b-f68f-40c6-8f59-f546fbaa27a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:07.874878 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ff44b-f68f-40c6-8f59-f546fbaa27a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:07.875664 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ff44b-f68f-40c6-8f59-f546fbaa27a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:07.876044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ff44b-f68f-40c6-8f59-f546fbaa27a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:07.877833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ff44b-f68f-40c6-8f59-f546fbaa27a5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:07.891522 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 641/1272] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:15:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:07.897581 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c266b5e-6144-4a8b-b3a6-b2b96abb91e0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:07.989221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:07.999554 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c266b5e-6144-4a8b-b3a6-b2b96abb91e0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:08.033919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c2b93-d76a-44cd-a578-11cb17b27012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:08.034578 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c2b93-d76a-44cd-a578-11cb17b27012 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:08.034853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c2b93-d76a-44cd-a578-11cb17b27012 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:08.035127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c2b93-d76a-44cd-a578-11cb17b27012 None admin] PATH_INFO: `/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/14ee6ffc0985405193735af49a398326/roles/97ece22f2e264e0e857d5107325a85d9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:08.037055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c2b93-d76a-44cd-a578-11cb17b27012 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7cdd07c79614516be35aa2d82ec6a3b, user_id=14ee6ffc0985405193735af49a398326, role_id=97ece22f2e264e0e857d5107325a85d9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:08.038471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c2b93-d76a-44cd-a578-11cb17b27012 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:08.052072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 632/1273] 10.222.0.107 () {58 vars in 1444 bytes} [Tue Aug 23 23:15:07 2022] PUT /identity/v3/projects/f7cdd07c79614516be35aa2d82ec6a3b/users/14ee6ffc0985405193735af49a398326/roles/97ece22f2e264e0e857d5107325a85d9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:15:09.973275 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab37a2-dd02-46a4-848e-394a99f87c58 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:09.973844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab37a2-dd02-46a4-848e-394a99f87c58 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:09.973844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab37a2-dd02-46a4-848e-394a99f87c58 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:09.975141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 642/1274] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:15:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:15:09.981188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac383b-99ad-41c0-ba21-5ba09436b0a3 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:09.981639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac383b-99ad-41c0-ba21-5ba09436b0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:09.982000 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac383b-99ad-41c0-ba21-5ba09436b0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:10.000481 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e7ac383b-99ad-41c0-ba21-5ba09436b0a3 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:10.001723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e7ac383b-99ad-41c0-ba21-5ba09436b0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:10.068229 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 633/1275] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:15:09 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:15:10.342764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab37a2-dd02-46a4-848e-394a99f87c58 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:10.443434 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab37a2-dd02-46a4-848e-394a99f87c58 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:10.460846 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:10.477985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9e4ed-1f3e-48b5-a0d5-af0025ccef55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:10.478613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9e4ed-1f3e-48b5-a0d5-af0025ccef55 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:10.478885 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9e4ed-1f3e-48b5-a0d5-af0025ccef55 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:10.479154 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9e4ed-1f3e-48b5-a0d5-af0025ccef55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:10.488915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9e4ed-1f3e-48b5-a0d5-af0025ccef55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:15:10.494349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-b8e9e4ed-1f3e-48b5-a0d5-af0025ccef55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:15:10.494349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:10.494349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:10.494349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:10.494349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:10.494349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:10.494349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:10.494349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:10.494349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:10.494349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:10.494349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:10.494349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:10.494349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:15:10.494349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:15:10.494349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:15:10.494349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:15:10.495504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:15:10.495504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:15:10.495504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:15:10.495504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:15:10.495504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:10.495504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:10.495504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:10.495504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:10.495504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:10.495504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:10.495504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:10.495504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:10.495504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:10.495504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:10.495504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:10.495504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:10.496754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:10.496754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:10.496754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:10.496754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:10.496754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:15:10.496754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:15:10.496754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:15:10.496754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:15:10.496754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:15:10.496754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:15:10.496754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:15:10.496754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:15:10.496754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 643/1276] 10.222.0.107 () {56 vars in 1101 bytes} [Tue Aug 23 23:15:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:10.501429 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac383b-99ad-41c0-ba21-5ba09436b0a3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:10.582610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:10.608985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac383b-99ad-41c0-ba21-5ba09436b0a3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:10.642709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ea502-61b9-44a2-8ba0-c9b52c5b5881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:10.643303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ea502-61b9-44a2-8ba0-c9b52c5b5881 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:10.643579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ea502-61b9-44a2-8ba0-c9b52c5b5881 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:10.643849 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ea502-61b9-44a2-8ba0-c9b52c5b5881 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:10.644509 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ea502-61b9-44a2-8ba0-c9b52c5b5881 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:10.646475 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ea502-61b9-44a2-8ba0-c9b52c5b5881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:10.647205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ea502-61b9-44a2-8ba0-c9b52c5b5881 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:10.656289 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 634/1277] 10.222.0.107 () {56 vars in 1104 bytes} [Tue Aug 23 23:15:10 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:10.662068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9e4ed-1f3e-48b5-a0d5-af0025ccef55 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:10.762305 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9e4ed-1f3e-48b5-a0d5-af0025ccef55 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:10.795505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca81638-15e5-40f3-9d62-971a9da4ef19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:10.796185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca81638-15e5-40f3-9d62-971a9da4ef19 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:10.796469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca81638-15e5-40f3-9d62-971a9da4ef19 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:10.796772 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca81638-15e5-40f3-9d62-971a9da4ef19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:10.807535 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca81638-15e5-40f3-9d62-971a9da4ef19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:10.809009 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca81638-15e5-40f3-9d62-971a9da4ef19 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:10.823221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-8ca81638-15e5-40f3-9d62-971a9da4ef19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:10.823221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:10.823221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:10.823221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:10.823221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:10.823221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:10.823221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:10.823221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:10.823221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:10.823221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:10.823221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:10.823221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:10.823221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:10.823221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:10.823221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:10.823221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:10.824354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:10.824354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:10.824354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:10.824354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:10.824354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:10.824354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:10.824354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:10.824354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:10.824354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:10.824354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:10.824354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:10.824354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:10.824354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:10.824354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:10.824354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:10.824354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:10.824354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:10.825525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:10.825525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:10.825525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:15:10.825525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 644/1278] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:10.830310 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ea502-61b9-44a2-8ba0-c9b52c5b5881 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:10.932075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ea502-61b9-44a2-8ba0-c9b52c5b5881 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:10.967898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2cc3f-78ee-492c-88f7-41bfc8d4ffa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:10.968501 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2cc3f-78ee-492c-88f7-41bfc8d4ffa1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:10.968805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2cc3f-78ee-492c-88f7-41bfc8d4ffa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:10.969075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2cc3f-78ee-492c-88f7-41bfc8d4ffa1 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:10.969710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2cc3f-78ee-492c-88f7-41bfc8d4ffa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:10.970009 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2cc3f-78ee-492c-88f7-41bfc8d4ffa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:10.971374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2cc3f-78ee-492c-88f7-41bfc8d4ffa1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:10.983676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 635/1279] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:15:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:10.989394 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca81638-15e5-40f3-9d62-971a9da4ef19 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:11.022911 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:11.093241 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca81638-15e5-40f3-9d62-971a9da4ef19 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:11.125701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9b7aa-9f05-4235-ae69-bf66f0a92ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:11.126317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9b7aa-9f05-4235-ae69-bf66f0a92ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:11.126595 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9b7aa-9f05-4235-ae69-bf66f0a92ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:11.126864 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9b7aa-9f05-4235-ae69-bf66f0a92ef1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:11.134826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9b7aa-9f05-4235-ae69-bf66f0a92ef1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:11.136250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9b7aa-9f05-4235-ae69-bf66f0a92ef1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:11.147336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-09b9b7aa-9f05-4235-ae69-bf66f0a92ef1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:15:11.147336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:11.147336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:11.147336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:11.147336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:11.147336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:11.147336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:11.147336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:11.147336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:11.147336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:11.147336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:11.147336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:11.147336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:15:11.147336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:15:11.147336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:15:11.147336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:15:11.148570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:11.148570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:11.148570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:15:11.148570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:15:11.148570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:15:11.148570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:15:11.148570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:11.148570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:11.148570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:11.148570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:11.148570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:11.148570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:11.148570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:11.148570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:11.148570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:11.148570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:11.148570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:11.148570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:11.150508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:11.150508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:11.150508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:15:11.150508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:15:11.150508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:15:11.150508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:15:11.150508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:15:11.150508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:15:11.150508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:15:11.150508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:15:11.150508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 645/1280] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:15:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:11.155055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2cc3f-78ee-492c-88f7-41bfc8d4ffa1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:11.158986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:11.252833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2cc3f-78ee-492c-88f7-41bfc8d4ffa1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:11.286055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fb585-1b80-4955-bd83-439b9bc4e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:11.286650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fb585-1b80-4955-bd83-439b9bc4e551 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:11.286927 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fb585-1b80-4955-bd83-439b9bc4e551 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:11.287198 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fb585-1b80-4955-bd83-439b9bc4e551 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:11.287916 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fb585-1b80-4955-bd83-439b9bc4e551 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:11.288215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fb585-1b80-4955-bd83-439b9bc4e551 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:11.289721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fb585-1b80-4955-bd83-439b9bc4e551 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:11.308677 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 636/1281] 10.222.0.107 () {56 vars in 1148 bytes} [Tue Aug 23 23:15:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:15:11.314548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9b7aa-9f05-4235-ae69-bf66f0a92ef1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:11.406394 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:11.416271 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9b7aa-9f05-4235-ae69-bf66f0a92ef1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:11.450513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a52f5b-d12a-4cf3-b68e-358badbeff5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:11.451110 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a52f5b-d12a-4cf3-b68e-358badbeff5b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:11.451386 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a52f5b-d12a-4cf3-b68e-358badbeff5b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:11.451653 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a52f5b-d12a-4cf3-b68e-358badbeff5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:11.517585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a52f5b-d12a-4cf3-b68e-358badbeff5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:11.518942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a52f5b-d12a-4cf3-b68e-358badbeff5b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:11.605161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:11.615934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 646/1282] 10.222.0.107 () {58 vars in 1287 bytes} [Tue Aug 23 23:15:11 2022] GET /identity/v3/auth/tokens => generated 2123 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:15:11.622561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fb585-1b80-4955-bd83-439b9bc4e551 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:11.684311 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:11.722611 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fb585-1b80-4955-bd83-439b9bc4e551 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:11.755162 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4376e5-2b15-4a3c-b608-7764bd6d213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:11.755780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4376e5-2b15-4a3c-b608-7764bd6d213b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:11.756058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4376e5-2b15-4a3c-b608-7764bd6d213b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:11.756330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4376e5-2b15-4a3c-b608-7764bd6d213b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:11.766536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4376e5-2b15-4a3c-b608-7764bd6d213b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:11.768026 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4376e5-2b15-4a3c-b608-7764bd6d213b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:11.783331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-fb4376e5-2b15-4a3c-b608-7764bd6d213b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:11.783331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:11.783331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:11.783331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:11.783331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:11.783331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:11.783331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:11.783331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:11.783331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:11.783331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:11.783331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:11.783331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:11.783331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:15:11.783331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:15:11.783331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:15:11.783331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:15:11.784487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:11.784487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:11.784487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:11.784487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:11.784487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:11.784487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:11.784487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:11.784487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:11.784487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:11.784487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:11.784487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:11.784487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:11.784487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:11.784487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:11.784487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:11.784487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:11.784487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:15:11.785651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:15:11.785651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:15:11.785651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:15:11.785651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 637/1283] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:11.790380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a52f5b-d12a-4cf3-b68e-358badbeff5b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:11.885930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a52f5b-d12a-4cf3-b68e-358badbeff5b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:11.919595 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c70ce-af29-429d-941f-bf7017a42957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:11.920184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c70ce-af29-429d-941f-bf7017a42957 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:11.920456 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c70ce-af29-429d-941f-bf7017a42957 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:11.920748 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c70ce-af29-429d-941f-bf7017a42957 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:11.921374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c70ce-af29-429d-941f-bf7017a42957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:11.921670 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c70ce-af29-429d-941f-bf7017a42957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:11.923004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c70ce-af29-429d-941f-bf7017a42957 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:11.934652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 647/1284] 10.222.0.107 () {56 vars in 1114 bytes} [Tue Aug 23 23:15:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:15:11.940332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4376e5-2b15-4a3c-b608-7764bd6d213b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:12.057016 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4376e5-2b15-4a3c-b608-7764bd6d213b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:12.070252 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:12.091243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5afb0-79b1-4a59-af7f-d5c4f2861790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:12.091865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5afb0-79b1-4a59-af7f-d5c4f2861790 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:12.092143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5afb0-79b1-4a59-af7f-d5c4f2861790 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:12.092414 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5afb0-79b1-4a59-af7f-d5c4f2861790 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:12.098931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5afb0-79b1-4a59-af7f-d5c4f2861790 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:12.100352 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5afb0-79b1-4a59-af7f-d5c4f2861790 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:12.111379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-dba5afb0-79b1-4a59-af7f-d5c4f2861790 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:15:12.111379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:12.111379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:12.111379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:12.111379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:12.111379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:12.111379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:12.111379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:12.111379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:12.111379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:12.111379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:12.111379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:12.111379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:15:12.111379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:15:12.111379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:15:12.112406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:15:12.112406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:12.112406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:12.112406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:12.112406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:12.112406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:12.112406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:12.112406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:12.112406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:12.112406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:12.112406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:12.112406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:12.112406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:12.112406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:12.112406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:12.112406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:12.112406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:12.113694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:15:12.113694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:15:12.113694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:15:12.113694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:15:12.113694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:15:12.113694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:15:12.113694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:15:12.113694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: ERROR keystone.server.flask.application Aug 23 23:15:12.113694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 638/1285] 10.222.0.107 () {56 vars in 1116 bytes} [Tue Aug 23 23:15:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:12.118998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c70ce-af29-429d-941f-bf7017a42957 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:12.170886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:12.220664 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c70ce-af29-429d-941f-bf7017a42957 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:12.253055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519e573-9f9f-4962-baad-e219111abc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:12.253651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519e573-9f9f-4962-baad-e219111abc01 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:12.253923 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519e573-9f9f-4962-baad-e219111abc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:12.254190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519e573-9f9f-4962-baad-e219111abc01 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:12.254867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519e573-9f9f-4962-baad-e219111abc01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:12.255165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519e573-9f9f-4962-baad-e219111abc01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:12.256583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519e573-9f9f-4962-baad-e219111abc01 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:12.268705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 648/1286] 10.222.0.107 () {56 vars in 1153 bytes} [Tue Aug 23 23:15:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:15:12.275034 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5afb0-79b1-4a59-af7f-d5c4f2861790 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:12.391696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5afb0-79b1-4a59-af7f-d5c4f2861790 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:12.424522 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4750a-dc58-4a6d-b2a1-f3157a0c9b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:12.425405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4750a-dc58-4a6d-b2a1-f3157a0c9b02 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:12.425678 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4750a-dc58-4a6d-b2a1-f3157a0c9b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:12.425939 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4750a-dc58-4a6d-b2a1-f3157a0c9b02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:12.426649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4750a-dc58-4a6d-b2a1-f3157a0c9b02 None admin] RBAC: Adding query filter params (role.id=97ece22f2e264e0e857d5107325a85d9, scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b, user.id=14ee6ffc0985405193735af49a398326) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:12.426947 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4750a-dc58-4a6d-b2a1-f3157a0c9b02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:12.428356 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4750a-dc58-4a6d-b2a1-f3157a0c9b02 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:12.434881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 639/1287] 10.222.0.107 () {56 vars in 1379 bytes} [Tue Aug 23 23:15:12 2022] GET /identity/v3/role_assignments?user.id=14ee6ffc0985405193735af49a398326&scope.project.id=f7cdd07c79614516be35aa2d82ec6a3b&role.id=97ece22f2e264e0e857d5107325a85d9 => generated 610 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:14.358380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e0d54-a34f-4a40-8913-0bd3ebdcb7ea None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:14.358897 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e0d54-a34f-4a40-8913-0bd3ebdcb7ea None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:14.358897 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e0d54-a34f-4a40-8913-0bd3ebdcb7ea None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:14.360193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 649/1288] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:15:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:15:14.365562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221844a-e928-4d0a-ac41-4eb5cd6229e7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:14.365964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221844a-e928-4d0a-ac41-4eb5cd6229e7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:14.365964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221844a-e928-4d0a-ac41-4eb5cd6229e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:14.384764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8221844a-e928-4d0a-ac41-4eb5cd6229e7 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:14.385963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8221844a-e928-4d0a-ac41-4eb5cd6229e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:14.415694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:14.455228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 640/1289] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:15:14 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:15:14.726792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e0d54-a34f-4a40-8913-0bd3ebdcb7ea None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:14.827221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e0d54-a34f-4a40-8913-0bd3ebdcb7ea None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:14.838619 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:14.861613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d28541-2e88-43a7-bc1e-e209f0244d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:14.862234 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d28541-2e88-43a7-bc1e-e209f0244d92 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:14.862513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d28541-2e88-43a7-bc1e-e209f0244d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:14.862785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d28541-2e88-43a7-bc1e-e209f0244d92 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:14.863366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d28541-2e88-43a7-bc1e-e209f0244d92 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:14.864766 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d28541-2e88-43a7-bc1e-e209f0244d92 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:14.873453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-31d28541-2e88-43a7-bc1e-e209f0244d92 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:15:14.873453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:14.873453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:15:14.873453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:15:14.873453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:15:14.873453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:15:14.873453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:15:14.873453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:15:14.873453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:15:14.873453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:15:14.873453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:15:14.873453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:15:14.873453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:14.873453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:14.873453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:14.873453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:14.873453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:14.874742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:14.874742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:14.874742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:14.874742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:14.874742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:14.874742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:14.874742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:15:14.874742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:15:14.874742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:15:14.874742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:15:14.874742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:14.874742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:14.874742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:14.874742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:14.874742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:14.874742 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:14.875817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:14.875817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:14.875817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:14.875817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:14.875817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:14.875817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:14.875817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:14.875817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:14.875817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:14.875817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:14.875817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:15:14.875817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:15:14.875817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:15:14.875817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:15:14.875817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 650/1290] 10.222.0.107 () {56 vars in 1122 bytes} [Tue Aug 23 23:15:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:14.880540 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221844a-e928-4d0a-ac41-4eb5cd6229e7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:14.979562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221844a-e928-4d0a-ac41-4eb5cd6229e7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:15.013430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117ab37-4514-4f64-b94d-ab316049e7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:15.014026 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117ab37-4514-4f64-b94d-ab316049e7ba None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:15.014296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117ab37-4514-4f64-b94d-ab316049e7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:15.014559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117ab37-4514-4f64-b94d-ab316049e7ba None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:15.015180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117ab37-4514-4f64-b94d-ab316049e7ba None admin] RBAC: Adding query filter params (name=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:15.015475 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117ab37-4514-4f64-b94d-ab316049e7ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:15.016850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117ab37-4514-4f64-b94d-ab316049e7ba None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:15.021488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 641/1291] 10.222.0.107 () {56 vars in 1121 bytes} [Tue Aug 23 23:15:14 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:15.027245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d28541-2e88-43a7-bc1e-e209f0244d92 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:15.127168 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d28541-2e88-43a7-bc1e-e209f0244d92 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:15.160513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1361417-29a7-4350-bb8f-d7b122485834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:15.161161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1361417-29a7-4350-bb8f-d7b122485834 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:15.161439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1361417-29a7-4350-bb8f-d7b122485834 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:15.161707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1361417-29a7-4350-bb8f-d7b122485834 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:15.162323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1361417-29a7-4350-bb8f-d7b122485834 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:15.162620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1361417-29a7-4350-bb8f-d7b122485834 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:15.163969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1361417-29a7-4350-bb8f-d7b122485834 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:15.168645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 651/1292] 10.222.0.107 () {56 vars in 1121 bytes} [Tue Aug 23 23:15:15 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:17.065322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae21cd-fa1e-40f4-beeb-7fe0e266b6dc None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:17.065838 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae21cd-fa1e-40f4-beeb-7fe0e266b6dc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:17.065958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae21cd-fa1e-40f4-beeb-7fe0e266b6dc None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:17.067212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 642/1293] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:15:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:15:17.073075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5128e91-6894-439f-834c-fb558015317a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:17.073552 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5128e91-6894-439f-834c-fb558015317a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:17.073655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5128e91-6894-439f-834c-fb558015317a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:17.091941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a5128e91-6894-439f-834c-fb558015317a None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:17.093154 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a5128e91-6894-439f-834c-fb558015317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:17.121960 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:17.159781 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 652/1294] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:15:17 2022] POST /identity/v3/auth/tokens => generated 2123 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:15:17.453600 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae21cd-fa1e-40f4-beeb-7fe0e266b6dc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:17.485250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:17.557231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae21cd-fa1e-40f4-beeb-7fe0e266b6dc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:17.591443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d732692-86fd-42f5-97a9-98f2762f1c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:17.592041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d732692-86fd-42f5-97a9-98f2762f1c7e None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:17.592323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d732692-86fd-42f5-97a9-98f2762f1c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:17.592614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d732692-86fd-42f5-97a9-98f2762f1c7e None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:17.593263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d732692-86fd-42f5-97a9-98f2762f1c7e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:17.594632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d732692-86fd-42f5-97a9-98f2762f1c7e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:17.610354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 643/1295] 10.222.0.107 () {60 vars in 1146 bytes} [Tue Aug 23 23:15:17 2022] POST /identity/v3/services => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:15:19.540534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fdd08-7dbe-4f72-a7dc-30a86881a431 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:19.541256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fdd08-7dbe-4f72-a7dc-30a86881a431 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:19.541256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fdd08-7dbe-4f72-a7dc-30a86881a431 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:19.542771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 653/1296] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:15:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:15:19.548136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fc397-dcbc-4712-a8ec-85d5a4470c34 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:19.548528 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fc397-dcbc-4712-a8ec-85d5a4470c34 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:19.548726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fc397-dcbc-4712-a8ec-85d5a4470c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:19.567837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f76fc397-dcbc-4712-a8ec-85d5a4470c34 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:19.569074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f76fc397-dcbc-4712-a8ec-85d5a4470c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:19.640736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 644/1297] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:15:19 2022] POST /identity/v3/auth/tokens => generated 2226 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:15:19.911322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fdd08-7dbe-4f72-a7dc-30a86881a431 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:20.011952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fdd08-7dbe-4f72-a7dc-30a86881a431 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:20.047932 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32266bd-be7f-473c-9c0c-00765ab61235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:20.048559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32266bd-be7f-473c-9c0c-00765ab61235 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:20.048867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32266bd-be7f-473c-9c0c-00765ab61235 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:20.049138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32266bd-be7f-473c-9c0c-00765ab61235 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:20.049717 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32266bd-be7f-473c-9c0c-00765ab61235 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:20.051336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32266bd-be7f-473c-9c0c-00765ab61235 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:20.060217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f32266bd-be7f-473c-9c0c-00765ab61235 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:15:20.060217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:20.060217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:15:20.060217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:15:20.060217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:15:20.060217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:15:20.060217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:15:20.060217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:15:20.060217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:15:20.060217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:15:20.060217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:15:20.060217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:15:20.060217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:20.060217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:20.060217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:20.060217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:20.060217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:20.061421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:20.061421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:20.061421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:20.061421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:20.061421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:20.061421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:20.061421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:15:20.061421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:15:20.061421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:15:20.061421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:15:20.061421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:20.061421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:20.061421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:20.061421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:20.061421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:20.061421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:20.062628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:20.062628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:20.062628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:20.062628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:20.062628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:20.062628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:20.062628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:20.062628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:20.062628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:20.062628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:20.062628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:15:20.062628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:15:20.062628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:15:20.062628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:15:20.062628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 654/1298] 10.222.0.107 () {56 vars in 1122 bytes} [Tue Aug 23 23:15:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:20.067326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fc397-dcbc-4712-a8ec-85d5a4470c34 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:20.085955 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:20.166061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fc397-dcbc-4712-a8ec-85d5a4470c34 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:20.200940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf568ba9-d2c4-412d-aa20-5fab6cfc52f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:20.201728 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf568ba9-d2c4-412d-aa20-5fab6cfc52f7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:20.201836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf568ba9-d2c4-412d-aa20-5fab6cfc52f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:20.202058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf568ba9-d2c4-412d-aa20-5fab6cfc52f7 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:20.202678 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf568ba9-d2c4-412d-aa20-5fab6cfc52f7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:20.202977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf568ba9-d2c4-412d-aa20-5fab6cfc52f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:20.204344 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf568ba9-d2c4-412d-aa20-5fab6cfc52f7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:20.209373 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 645/1299] 10.222.0.107 () {56 vars in 1121 bytes} [Tue Aug 23 23:15:20 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:20.216145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32266bd-be7f-473c-9c0c-00765ab61235 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:20.254033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:20.322737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32266bd-be7f-473c-9c0c-00765ab61235 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:20.354922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadfccd-22d5-4819-8a19-db9c0981e85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:20.355511 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadfccd-22d5-4819-8a19-db9c0981e85b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:20.355789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadfccd-22d5-4819-8a19-db9c0981e85b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:20.356056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadfccd-22d5-4819-8a19-db9c0981e85b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:20.356779 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadfccd-22d5-4819-8a19-db9c0981e85b None admin] RBAC: Adding query filter params (interface=public, service_id=293ba7974e2d4758ad879c64de94a38e, region_id=RegionOne) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:20.357085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadfccd-22d5-4819-8a19-db9c0981e85b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:20.358439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadfccd-22d5-4819-8a19-db9c0981e85b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:20.363315 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 655/1300] 10.222.0.107 () {56 vars in 1256 bytes} [Tue Aug 23 23:15:20 2022] GET /identity/v3/endpoints?service_id=293ba7974e2d4758ad879c64de94a38e&interface=public®ion_id=RegionOne => generated 195 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:15:20.369650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf568ba9-d2c4-412d-aa20-5fab6cfc52f7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:20.450616 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:20.468675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf568ba9-d2c4-412d-aa20-5fab6cfc52f7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:20.501525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b4e96-031e-4646-98ec-602b5bce712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:20.502143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b4e96-031e-4646-98ec-602b5bce712d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:20.502415 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b4e96-031e-4646-98ec-602b5bce712d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:20.502688 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b4e96-031e-4646-98ec-602b5bce712d None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:20.503271 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b4e96-031e-4646-98ec-602b5bce712d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:20.504639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b4e96-031e-4646-98ec-602b5bce712d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:20.511796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 646/1301] 10.222.0.107 () {56 vars in 1092 bytes} [Tue Aug 23 23:15:20 2022] GET /identity/v3/services => generated 2201 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:15:22.411819 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc858a43-3f70-4647-82a7-9737ed540110 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:22.412326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc858a43-3f70-4647-82a7-9737ed540110 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:22.412326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc858a43-3f70-4647-82a7-9737ed540110 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:22.413652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 656/1302] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:15:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:15:22.419508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e95e1-0886-481b-9245-3f9b4b88723e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:22.419923 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e95e1-0886-481b-9245-3f9b4b88723e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:22.420063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e95e1-0886-481b-9245-3f9b4b88723e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:22.438336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8c6e95e1-0886-481b-9245-3f9b4b88723e None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:22.439529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8c6e95e1-0886-481b-9245-3f9b4b88723e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:22.505893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 647/1303] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:15:22 2022] POST /identity/v3/auth/tokens => generated 2226 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:15:22.786241 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc858a43-3f70-4647-82a7-9737ed540110 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:22.882124 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:22.890191 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc858a43-3f70-4647-82a7-9737ed540110 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:22.923604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee5988-9cf9-4860-8114-d2b96a96a180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:22.924221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee5988-9cf9-4860-8114-d2b96a96a180 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:22.924499 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee5988-9cf9-4860-8114-d2b96a96a180 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:22.924792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee5988-9cf9-4860-8114-d2b96a96a180 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:22.925628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee5988-9cf9-4860-8114-d2b96a96a180 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:22.926974 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee5988-9cf9-4860-8114-d2b96a96a180 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:22.935894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-65ee5988-9cf9-4860-8114-d2b96a96a180 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:15:22.935894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:22.935894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:15:22.935894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:15:22.935894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:15:22.935894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:15:22.935894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:15:22.935894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:15:22.935894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:15:22.935894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:15:22.935894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:15:22.935894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:15:22.935894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:15:22.935894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:15:22.935894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:15:22.935894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:15:22.935894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:15:22.937085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:15:22.937085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:15:22.937085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:15:22.937085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:15:22.937085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:15:22.937085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:15:22.937085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:15:22.937085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:15:22.937085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:15:22.937085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:15:22.937085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:15:22.937085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:15:22.937085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:15:22.937085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:15:22.937085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:15:22.937085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:15:22.937961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:15:22.937961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Aug 23 23:15:22.937961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:15:22.937961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:15:22.937961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:15:22.937961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:15:22.937961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:15:22.937961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:15:22.937961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:15:22.937961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:15:22.937961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:15:22.937961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:15:22.937961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:15:22.937961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: ERROR keystone.server.flask.application Aug 23 23:15:22.937961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 657/1304] 10.222.0.107 () {56 vars in 1122 bytes} [Tue Aug 23 23:15:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:15:22.943651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e95e1-0886-481b-9245-3f9b4b88723e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:23.022334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:23.046349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e95e1-0886-481b-9245-3f9b4b88723e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:23.081087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ce254-77db-4273-8e27-0914b5799d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:23.081694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ce254-77db-4273-8e27-0914b5799d54 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:23.081973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ce254-77db-4273-8e27-0914b5799d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:23.082249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ce254-77db-4273-8e27-0914b5799d54 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:23.082877 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ce254-77db-4273-8e27-0914b5799d54 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:15:23.083181 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ce254-77db-4273-8e27-0914b5799d54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:23.084556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ce254-77db-4273-8e27-0914b5799d54 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:23.090483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 648/1305] 10.222.0.107 () {56 vars in 1121 bytes} [Tue Aug 23 23:15:22 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:15:23.096259 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee5988-9cf9-4860-8114-d2b96a96a180 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:23.194098 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee5988-9cf9-4860-8114-d2b96a96a180 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:23.228252 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0419a8-ae95-4d93-8962-5e1e834e26cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:23.228880 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0419a8-ae95-4d93-8962-5e1e834e26cf None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:23.229157 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0419a8-ae95-4d93-8962-5e1e834e26cf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:23.229428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0419a8-ae95-4d93-8962-5e1e834e26cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:23.230086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0419a8-ae95-4d93-8962-5e1e834e26cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:23.231443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0419a8-ae95-4d93-8962-5e1e834e26cf None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:23.250943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 658/1306] 10.222.0.107 () {60 vars in 1149 bytes} [Tue Aug 23 23:15:23 2022] POST /identity/v3/endpoints => generated 333 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:15:33.087678 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=30 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:33.247888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:28.482919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127345a-a511-4f7f-833f-d03f89100c22 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:28.483378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127345a-a511-4f7f-833f-d03f89100c22 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:28.483480 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127345a-a511-4f7f-833f-d03f89100c22 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:28.489137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 649/1307] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:16:28 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:16:28.490469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a71788-3e11-4314-806e-515c44b62f50 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:28.491186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a71788-3e11-4314-806e-515c44b62f50 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:28.491186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a71788-3e11-4314-806e-515c44b62f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:28.648553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-65a71788-3e11-4314-806e-515c44b62f50 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:16:28.650576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-65a71788-3e11-4314-806e-515c44b62f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:28.803884 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 659/1308] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:16:28 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:16:29.101046 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ca0f9-56a6-43e0-8528-6afad105efe2 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:29.101607 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ca0f9-56a6-43e0-8528-6afad105efe2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:29.101896 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ca0f9-56a6-43e0-8528-6afad105efe2 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:29.104274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 650/1309] 10.222.0.107 () {54 vars in 970 bytes} [Tue Aug 23 23:16:29 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:16:29.110934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e31ac4-3dd4-41cf-8217-e842f6c1cc1a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:29.111409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e31ac4-3dd4-41cf-8217-e842f6c1cc1a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:29.111890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e31ac4-3dd4-41cf-8217-e842f6c1cc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:29.220347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-67e31ac4-3dd4-41cf-8217-e842f6c1cc1a None None] MFA Rules not processed for user `b88d0d18ad66438191541b84fc1431bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:16:29.221825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-67e31ac4-3dd4-41cf-8217-e842f6c1cc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:29.247276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:29.320706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 660/1310] 10.222.0.107 () {58 vars in 1067 bytes} [Tue Aug 23 23:16:29 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:16:29.330322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ca0f9-56a6-43e0-8528-6afad105efe2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:16:29.332209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cc3ca0f9-56a6-43e0-8528-6afad105efe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:29.455851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ca0f9-56a6-43e0-8528-6afad105efe2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:16:29.546113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5165f48-0f00-48f2-b5c0-1407ce8e58b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:16:29.547469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5165f48-0f00-48f2-b5c0-1407ce8e58b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:29.547936 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5165f48-0f00-48f2-b5c0-1407ce8e58b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:29.548422 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5165f48-0f00-48f2-b5c0-1407ce8e58b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:29.550780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b5165f48-0f00-48f2-b5c0-1407ce8e58b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:29.623508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:29.694079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5165f48-0f00-48f2-b5c0-1407ce8e58b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:16:29.696179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5165f48-0f00-48f2-b5c0-1407ce8e58b6 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:16:29.734285 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 651/1311] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:16:29 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:16:31.989819 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b9056-12d5-453a-90cd-9570a1ae8289 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:31.990318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b9056-12d5-453a-90cd-9570a1ae8289 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:31.990415 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b9056-12d5-453a-90cd-9570a1ae8289 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:31.995952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 661/1312] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:16:31 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:16:31.997729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012488f-449a-4066-825f-c101fd5663d8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:31.998530 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012488f-449a-4066-825f-c101fd5663d8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:31.998808 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012488f-449a-4066-825f-c101fd5663d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:32.073482 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5012488f-449a-4066-825f-c101fd5663d8 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:16:32.074721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5012488f-449a-4066-825f-c101fd5663d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:32.172682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 652/1313] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:16:31 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:16:32.455330 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b9056-12d5-453a-90cd-9570a1ae8289 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:16:32.456919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ff4b9056-12d5-453a-90cd-9570a1ae8289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:32.568899 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b9056-12d5-453a-90cd-9570a1ae8289 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:16:32.646986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:32.650409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763b867-5d0f-4569-995b-dde41626cabd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:16:32.651327 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763b867-5d0f-4569-995b-dde41626cabd service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:32.651834 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763b867-5d0f-4569-995b-dde41626cabd service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:32.652159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763b867-5d0f-4569-995b-dde41626cabd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:32.654103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b763b867-5d0f-4569-995b-dde41626cabd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:32.773524 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763b867-5d0f-4569-995b-dde41626cabd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:16:32.775716 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763b867-5d0f-4569-995b-dde41626cabd service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:16:32.795258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 662/1314] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:16:32 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:16:35.040442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986d926-197e-4797-af3c-07371386e0af None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:35.041024 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986d926-197e-4797-af3c-07371386e0af None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:35.041024 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986d926-197e-4797-af3c-07371386e0af None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:35.042287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 653/1315] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:16:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:16:35.047618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fdf40-196f-49c7-8e67-574c910c8542 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:35.048022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fdf40-196f-49c7-8e67-574c910c8542 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:35.048236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fdf40-196f-49c7-8e67-574c910c8542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:35.117280 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ed9fdf40-196f-49c7-8e67-574c910c8542 None None] MFA Rules not processed for user `42c3d6abafce4a929b4b6685de4943e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:16:35.118752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ed9fdf40-196f-49c7-8e67-574c910c8542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:35.170377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:35.216238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 663/1316] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:16:35 2022] POST /identity/v3/auth/tokens => generated 3253 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:16:35.507455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986d926-197e-4797-af3c-07371386e0af None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:16:35.509906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f986d926-197e-4797-af3c-07371386e0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:35.519529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:35.615124 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986d926-197e-4797-af3c-07371386e0af None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:16:35.689701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72852f-a9bd-45b4-96c1-d2048c6564ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:16:35.690215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72852f-a9bd-45b4-96c1-d2048c6564ab service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:35.690491 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72852f-a9bd-45b4-96c1-d2048c6564ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:35.690766 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72852f-a9bd-45b4-96c1-d2048c6564ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:35.692380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2c72852f-a9bd-45b4-96c1-d2048c6564ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:35.754075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:35.801651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72852f-a9bd-45b4-96c1-d2048c6564ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:16:35.803358 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72852f-a9bd-45b4-96c1-d2048c6564ab service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:16:35.821715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 654/1317] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:16:35 2022] GET /identity/v3/auth/tokens => generated 3253 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:16:38.278801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810d149-a877-4e8d-a284-7ec79d295988 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:38.279314 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810d149-a877-4e8d-a284-7ec79d295988 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:38.279314 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810d149-a877-4e8d-a284-7ec79d295988 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:38.280645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 664/1318] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:16:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:16:38.286885 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d9c9b-6d2e-45cf-969b-bb22fa39951b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:38.287353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d9c9b-6d2e-45cf-969b-bb22fa39951b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:38.287476 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d9c9b-6d2e-45cf-969b-bb22fa39951b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:38.354425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-401d9c9b-6d2e-45cf-969b-bb22fa39951b None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:16:38.355624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-401d9c9b-6d2e-45cf-969b-bb22fa39951b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:38.476137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 655/1319] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:16:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:16:38.818802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810d149-a877-4e8d-a284-7ec79d295988 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:16:38.820377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6810d149-a877-4e8d-a284-7ec79d295988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:38.935900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810d149-a877-4e8d-a284-7ec79d295988 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:16:39.021175 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb279e1b-1e03-492f-ba3e-c3d52899e6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:16:39.022039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb279e1b-1e03-492f-ba3e-c3d52899e6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:39.022583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb279e1b-1e03-492f-ba3e-c3d52899e6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:39.022938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb279e1b-1e03-492f-ba3e-c3d52899e6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:39.025466 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cb279e1b-1e03-492f-ba3e-c3d52899e6e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:39.035118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:39.155832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb279e1b-1e03-492f-ba3e-c3d52899e6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:16:39.157809 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb279e1b-1e03-492f-ba3e-c3d52899e6e8 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:16:39.180874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 665/1320] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:16:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:16:41.800009 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77de79d-4272-4d3b-b23d-6e292d2fe882 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:41.800618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77de79d-4272-4d3b-b23d-6e292d2fe882 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:41.800618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77de79d-4272-4d3b-b23d-6e292d2fe882 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:41.801905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 656/1321] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:16:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:16:41.807601 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2da213-8171-4cab-be9a-3939e0fb7ebd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:41.808043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2da213-8171-4cab-be9a-3939e0fb7ebd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:41.808140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2da213-8171-4cab-be9a-3939e0fb7ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:41.875609 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4f2da213-8171-4cab-be9a-3939e0fb7ebd None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:16:41.876912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4f2da213-8171-4cab-be9a-3939e0fb7ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:41.948743 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:41.990871 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 666/1322] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:16:41 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:16:42.297794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13c163-9bba-41ee-b2af-bbf87f67d4df None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:42.298301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13c163-9bba-41ee-b2af-bbf87f67d4df None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:42.298795 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13c163-9bba-41ee-b2af-bbf87f67d4df None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:42.300350 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 657/1323] 10.222.0.107 () {54 vars in 970 bytes} [Tue Aug 23 23:16:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:16:42.309788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d589c2e-0730-4082-9d9d-f4d9d2aed806 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:42.310063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d589c2e-0730-4082-9d9d-f4d9d2aed806 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:42.310340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d589c2e-0730-4082-9d9d-f4d9d2aed806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:42.392754 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8d589c2e-0730-4082-9d9d-f4d9d2aed806 None None] MFA Rules not processed for user `b88d0d18ad66438191541b84fc1431bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:16:42.393978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8d589c2e-0730-4082-9d9d-f4d9d2aed806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:42.471707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 667/1324] 10.222.0.107 () {58 vars in 1067 bytes} [Tue Aug 23 23:16:42 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:16:42.480859 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13c163-9bba-41ee-b2af-bbf87f67d4df None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:16:42.482400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0b13c163-9bba-41ee-b2af-bbf87f67d4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:42.502849 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:42.592701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13c163-9bba-41ee-b2af-bbf87f67d4df None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:16:42.669552 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457be2c-01db-4aec-af7b-be69d33171fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:16:42.670582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457be2c-01db-4aec-af7b-be69d33171fa service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:42.671086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457be2c-01db-4aec-af7b-be69d33171fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:42.671578 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457be2c-01db-4aec-af7b-be69d33171fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:42.673475 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2457be2c-01db-4aec-af7b-be69d33171fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:42.749926 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:42.789036 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457be2c-01db-4aec-af7b-be69d33171fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:16:42.790526 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457be2c-01db-4aec-af7b-be69d33171fa service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:16:42.810074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 658/1325] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:16:42 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:16:45.013344 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d2c6b-05c1-41fa-9601-2d0bab18ae3b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:45.013890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d2c6b-05c1-41fa-9601-2d0bab18ae3b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:45.013890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d2c6b-05c1-41fa-9601-2d0bab18ae3b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:45.015380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 668/1326] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:16:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:16:45.021101 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c23a4d-7407-4733-89e1-591a960b0e26 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:45.021629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c23a4d-7407-4733-89e1-591a960b0e26 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:45.021721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c23a4d-7407-4733-89e1-591a960b0e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:45.098700 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-79c23a4d-7407-4733-89e1-591a960b0e26 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:16:45.099918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-79c23a4d-7407-4733-89e1-591a960b0e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:45.198068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 659/1327] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:16:45 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:16:45.497099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d2c6b-05c1-41fa-9601-2d0bab18ae3b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:16:45.498640 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c73d2c6b-05c1-41fa-9601-2d0bab18ae3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:45.562099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:45.607230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d2c6b-05c1-41fa-9601-2d0bab18ae3b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:16:45.683066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb9ef1-2a5b-4570-8478-e16697498061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:16:45.683677 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb9ef1-2a5b-4570-8478-e16697498061 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:45.683948 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb9ef1-2a5b-4570-8478-e16697498061 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:45.684210 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb9ef1-2a5b-4570-8478-e16697498061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:45.685831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-10eb9ef1-2a5b-4570-8478-e16697498061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:45.795815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:45.798207 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb9ef1-2a5b-4570-8478-e16697498061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:16:45.799782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb9ef1-2a5b-4570-8478-e16697498061 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:16:45.820427 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 669/1328] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:16:45 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:16:47.825409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8730c-4334-488f-8e15-e621cd9d45c7 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:47.825828 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8730c-4334-488f-8e15-e621cd9d45c7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:47.825921 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8730c-4334-488f-8e15-e621cd9d45c7 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:47.827664 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 660/1329] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:16:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:16:47.833418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea916be-ad24-4566-ad7e-3e76c05bd13f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:47.833889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea916be-ad24-4566-ad7e-3e76c05bd13f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:47.833979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea916be-ad24-4566-ad7e-3e76c05bd13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:47.907645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3ea916be-ad24-4566-ad7e-3e76c05bd13f None None] MFA Rules not processed for user `42c3d6abafce4a929b4b6685de4943e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:16:47.908746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3ea916be-ad24-4566-ad7e-3e76c05bd13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:48.011364 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 670/1330] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:16:47 2022] POST /identity/v3/auth/tokens => generated 3253 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:16:48.297058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8730c-4334-488f-8e15-e621cd9d45c7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:16:48.299070 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ebd8730c-4334-488f-8e15-e621cd9d45c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:48.334929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:48.416660 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8730c-4334-488f-8e15-e621cd9d45c7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:16:48.496441 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b51f3f-73a6-41ff-a0ee-0a014dcbcbae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:16:48.497085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b51f3f-73a6-41ff-a0ee-0a014dcbcbae service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:48.497365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b51f3f-73a6-41ff-a0ee-0a014dcbcbae service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:48.497635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b51f3f-73a6-41ff-a0ee-0a014dcbcbae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:48.499288 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b0b51f3f-73a6-41ff-a0ee-0a014dcbcbae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:48.582662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:48.617145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b51f3f-73a6-41ff-a0ee-0a014dcbcbae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:16:48.618842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b51f3f-73a6-41ff-a0ee-0a014dcbcbae service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:16:48.640565 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 661/1331] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:16:48 2022] GET /identity/v3/auth/tokens => generated 3253 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:16:50.789075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1f435-3e0e-4395-9e11-575ad72e793b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:50.789615 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1f435-3e0e-4395-9e11-575ad72e793b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:50.789615 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1f435-3e0e-4395-9e11-575ad72e793b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:50.790979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 671/1332] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:16:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:16:50.796212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dce17-4475-43c6-ba7f-254aae6d8f10 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:50.796646 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dce17-4475-43c6-ba7f-254aae6d8f10 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:50.796781 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dce17-4475-43c6-ba7f-254aae6d8f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:50.862195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-851dce17-4475-43c6-ba7f-254aae6d8f10 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:16:50.863382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-851dce17-4475-43c6-ba7f-254aae6d8f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:50.958157 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 662/1333] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:16:50 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:16:51.236639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1f435-3e0e-4395-9e11-575ad72e793b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:16:51.238182 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5bb1f435-3e0e-4395-9e11-575ad72e793b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:51.310708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:51.345888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1f435-3e0e-4395-9e11-575ad72e793b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:16:51.432381 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e5a96-1e9e-46da-a2ef-4952df3cfbfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:16:51.433005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e5a96-1e9e-46da-a2ef-4952df3cfbfe service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:51.433279 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e5a96-1e9e-46da-a2ef-4952df3cfbfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:51.433544 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e5a96-1e9e-46da-a2ef-4952df3cfbfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:51.435144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-629e5a96-1e9e-46da-a2ef-4952df3cfbfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:51.547942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e5a96-1e9e-46da-a2ef-4952df3cfbfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:16:51.549357 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e5a96-1e9e-46da-a2ef-4952df3cfbfe service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:16:51.560229 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:51.568695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 672/1334] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:16:51 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:16:53.538116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc935e-abd9-4c3a-9160-fdd042b951d7 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:53.538649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc935e-abd9-4c3a-9160-fdd042b951d7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:53.538649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc935e-abd9-4c3a-9160-fdd042b951d7 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:53.540099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 663/1335] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:16:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:16:53.546002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cc1ff-5ba3-4f81-ae0c-b92404d194da None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:53.546395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cc1ff-5ba3-4f81-ae0c-b92404d194da None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:53.546551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cc1ff-5ba3-4f81-ae0c-b92404d194da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:53.612513 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-850cc1ff-5ba3-4f81-ae0c-b92404d194da None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:16:53.613739 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-850cc1ff-5ba3-4f81-ae0c-b92404d194da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:53.710494 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 673/1336] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:16:53 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:16:53.995343 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc935e-abd9-4c3a-9160-fdd042b951d7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:16:53.997199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7afc935e-abd9-4c3a-9160-fdd042b951d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:54.037238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:54.101750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc935e-abd9-4c3a-9160-fdd042b951d7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:16:54.175385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae08d2-2ff9-4634-bc97-b4c00c23d0a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:16:54.175988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae08d2-2ff9-4634-bc97-b4c00c23d0a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:54.176267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae08d2-2ff9-4634-bc97-b4c00c23d0a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:54.176545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae08d2-2ff9-4634-bc97-b4c00c23d0a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:54.178189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e1ae08d2-2ff9-4634-bc97-b4c00c23d0a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:54.263968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:54.291063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae08d2-2ff9-4634-bc97-b4c00c23d0a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:16:54.292516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae08d2-2ff9-4634-bc97-b4c00c23d0a5 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:16:54.310905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 664/1337] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:16:53 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:16:56.555089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d0ea5-fd23-4ac8-bf43-609470f59819 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:56.555677 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d0ea5-fd23-4ac8-bf43-609470f59819 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:56.555854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d0ea5-fd23-4ac8-bf43-609470f59819 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:56.557148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 674/1338] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:16:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:16:56.562222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee26f0-2ce3-4c35-a6d2-6c380fbbc2f8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:56.562650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee26f0-2ce3-4c35-a6d2-6c380fbbc2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:56.562761 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee26f0-2ce3-4c35-a6d2-6c380fbbc2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:56.629040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a5ee26f0-2ce3-4c35-a6d2-6c380fbbc2f8 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:16:56.630257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a5ee26f0-2ce3-4c35-a6d2-6c380fbbc2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:56.728451 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 665/1339] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:16:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:16:57.012050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d0ea5-fd23-4ac8-bf43-609470f59819 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:16:57.013644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-257d0ea5-fd23-4ac8-bf43-609470f59819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:57.092150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:16:57.120364 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d0ea5-fd23-4ac8-bf43-609470f59819 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:16:57.193578 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04943cdf-0721-43c1-9c6d-25c69905abb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:16:57.193800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04943cdf-0721-43c1-9c6d-25c69905abb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:16:57.194056 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04943cdf-0721-43c1-9c6d-25c69905abb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:16:57.194333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04943cdf-0721-43c1-9c6d-25c69905abb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:16:57.195955 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-04943cdf-0721-43c1-9c6d-25c69905abb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:16:57.307140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04943cdf-0721-43c1-9c6d-25c69905abb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:16:57.308559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04943cdf-0721-43c1-9c6d-25c69905abb8 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:16:57.327376 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 675/1340] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:16:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:17:01.247431 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e262d-d3a1-4a1f-aff1-005ad6ef69ee None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:01.247994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e262d-d3a1-4a1f-aff1-005ad6ef69ee None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:01.247994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e262d-d3a1-4a1f-aff1-005ad6ef69ee None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:01.249888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 666/1341] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:17:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:01.254824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b6527-f638-47aa-987c-4e217a63b692 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:01.255302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b6527-f638-47aa-987c-4e217a63b692 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:01.255410 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b6527-f638-47aa-987c-4e217a63b692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:01.261626 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:01.335805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-367b6527-f638-47aa-987c-4e217a63b692 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:01.337740 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-367b6527-f638-47aa-987c-4e217a63b692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:01.437446 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 676/1342] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:17:01 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:01.735733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e262d-d3a1-4a1f-aff1-005ad6ef69ee None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:01.737327 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cb1e262d-d3a1-4a1f-aff1-005ad6ef69ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:01.787595 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:01.847287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e262d-d3a1-4a1f-aff1-005ad6ef69ee None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:01.926136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5a352-0a36-42db-a02b-15bec0e433c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:01.926739 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5a352-0a36-42db-a02b-15bec0e433c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:01.927013 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5a352-0a36-42db-a02b-15bec0e433c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:01.927289 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5a352-0a36-42db-a02b-15bec0e433c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:01.929169 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-44f5a352-0a36-42db-a02b-15bec0e433c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:02.039826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:02.050336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5a352-0a36-42db-a02b-15bec0e433c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:02.051780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5a352-0a36-42db-a02b-15bec0e433c4 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:02.070090 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 667/1343] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:17:01 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:17:04.685821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ceb08-0827-438d-a90a-50d815354e17 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:04.686391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ceb08-0827-438d-a90a-50d815354e17 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:04.686391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ceb08-0827-438d-a90a-50d815354e17 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:04.687952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 677/1344] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:17:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:04.693787 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd50ee-c2a2-4a2d-b373-8d2d956a1d1d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:04.694354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd50ee-c2a2-4a2d-b373-8d2d956a1d1d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:04.694354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd50ee-c2a2-4a2d-b373-8d2d956a1d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:04.762245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-49cd50ee-c2a2-4a2d-b373-8d2d956a1d1d None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:04.763473 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-49cd50ee-c2a2-4a2d-b373-8d2d956a1d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:04.863913 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 668/1345] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:17:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:05.149938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ceb08-0827-438d-a90a-50d815354e17 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:05.151495 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fe4ceb08-0827-438d-a90a-50d815354e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:05.241346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:05.259743 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ceb08-0827-438d-a90a-50d815354e17 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:05.345063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c8747-897d-4afe-922d-a32924c31e2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:05.345693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c8747-897d-4afe-922d-a32924c31e2d service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:05.345973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c8747-897d-4afe-922d-a32924c31e2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:05.346239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c8747-897d-4afe-922d-a32924c31e2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:05.348026 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-738c8747-897d-4afe-922d-a32924c31e2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:05.459200 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c8747-897d-4afe-922d-a32924c31e2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:05.460722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c8747-897d-4afe-922d-a32924c31e2d service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:05.480351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 678/1346] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:17:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:17:09.487375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84f961-413d-46d6-b616-c2d4666598a1 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:09.487848 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84f961-413d-46d6-b616-c2d4666598a1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:09.487934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84f961-413d-46d6-b616-c2d4666598a1 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:09.496163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf790e-d207-48e1-bd61-616c7e7ebe51 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:09.496759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf790e-d207-48e1-bd61-616c7e7ebe51 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:09.496759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf790e-d207-48e1-bd61-616c7e7ebe51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:09.501748 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 669/1347] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:17:09 2022] GET /identity => generated 271 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:09.515472 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:09.577204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-38bf790e-d207-48e1-bd61-616c7e7ebe51 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:09.578578 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-38bf790e-d207-48e1-bd61-616c7e7ebe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:09.687647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 679/1348] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:17:09 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:09.971230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84f961-413d-46d6-b616-c2d4666598a1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:09.972934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cf84f961-413d-46d6-b616-c2d4666598a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:10.037334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:10.093357 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84f961-413d-46d6-b616-c2d4666598a1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:10.187736 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cb845-2f55-4f99-9251-5b2b1de4f1d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:10.188345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cb845-2f55-4f99-9251-5b2b1de4f1d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:10.188645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cb845-2f55-4f99-9251-5b2b1de4f1d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:10.189393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cb845-2f55-4f99-9251-5b2b1de4f1d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:10.190580 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dc4cb845-2f55-4f99-9251-5b2b1de4f1d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:10.312185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:10.317055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cb845-2f55-4f99-9251-5b2b1de4f1d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:10.318579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cb845-2f55-4f99-9251-5b2b1de4f1d5 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:10.339334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 670/1349] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:17:09 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:17:15.398826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5c28c-0aab-4e81-becd-280365b48283 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:15.398826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5c28c-0aab-4e81-becd-280365b48283 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:15.398826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5c28c-0aab-4e81-becd-280365b48283 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:15.402979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 680/1350] 10.222.0.107 () {54 vars in 926 bytes} [Tue Aug 23 23:17:15 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:15.408685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6be94-dd43-498c-9b7a-92070f57335b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:15.409453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6be94-dd43-498c-9b7a-92070f57335b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:15.409904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6be94-dd43-498c-9b7a-92070f57335b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:15.555380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-fea6be94-dd43-498c-9b7a-92070f57335b None None] MFA Rules not processed for user `14ee6ffc0985405193735af49a398326`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:15.557439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fea6be94-dd43-498c-9b7a-92070f57335b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:15.707187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 671/1351] 10.222.0.107 () {58 vars in 1023 bytes} [Tue Aug 23 23:17:15 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:19.685716 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=59 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:19.964617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba37b3-c855-4ab2-951b-c8cfd9a1dcfc None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:19.965135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba37b3-c855-4ab2-951b-c8cfd9a1dcfc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:19.965506 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba37b3-c855-4ab2-951b-c8cfd9a1dcfc None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:19.966936 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 681/1352] 10.222.0.107 () {54 vars in 926 bytes} [Tue Aug 23 23:17:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:19.972422 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126a0e8-1410-499d-a54e-9d4092deb125 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:19.972923 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126a0e8-1410-499d-a54e-9d4092deb125 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:19.973008 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126a0e8-1410-499d-a54e-9d4092deb125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:20.046711 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:20.074185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5126a0e8-1410-499d-a54e-9d4092deb125 None None] MFA Rules not processed for user `14ee6ffc0985405193735af49a398326`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:20.075421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5126a0e8-1410-499d-a54e-9d4092deb125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:20.191316 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 672/1353] 10.222.0.107 () {58 vars in 1023 bytes} [Tue Aug 23 23:17:19 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:21.547711 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e29f9-2d56-4d91-947e-23743462140f None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:21.550260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e29f9-2d56-4d91-947e-23743462140f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:21.550260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e29f9-2d56-4d91-947e-23743462140f None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:21.550744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 682/1354] 10.222.0.107 () {54 vars in 926 bytes} [Tue Aug 23 23:17:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:21.556971 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42629c70-b8b3-437f-8514-d4be9e1e4165 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:21.557500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42629c70-b8b3-437f-8514-d4be9e1e4165 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:21.557500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42629c70-b8b3-437f-8514-d4be9e1e4165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:21.638448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-42629c70-b8b3-437f-8514-d4be9e1e4165 None None] MFA Rules not processed for user `14ee6ffc0985405193735af49a398326`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:21.639676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-42629c70-b8b3-437f-8514-d4be9e1e4165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:21.684755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:21.752945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 673/1355] 10.222.0.107 () {58 vars in 1023 bytes} [Tue Aug 23 23:17:21 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:25.159945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae51cf-1afc-4c63-9ada-658b9748fb1e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:25.160521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae51cf-1afc-4c63-9ada-658b9748fb1e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:25.160521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae51cf-1afc-4c63-9ada-658b9748fb1e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:25.161851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 683/1356] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:17:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:25.167503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439aa00b-43a8-49ec-a45a-f10ecfac07e7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:25.168409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439aa00b-43a8-49ec-a45a-f10ecfac07e7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:25.168925 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439aa00b-43a8-49ec-a45a-f10ecfac07e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:25.265711 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-439aa00b-43a8-49ec-a45a-f10ecfac07e7 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:25.266997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-439aa00b-43a8-49ec-a45a-f10ecfac07e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:25.420527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 674/1357] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:17:25 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:25.727372 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f814e9c-1ad3-45b2-a2ed-1fe507468c2b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:25.728567 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f814e9c-1ad3-45b2-a2ed-1fe507468c2b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:25.729209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f814e9c-1ad3-45b2-a2ed-1fe507468c2b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:25.731402 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 684/1358] 10.222.0.107 () {54 vars in 967 bytes} [Tue Aug 23 23:17:25 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:25.744955 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035f6cb-485c-4f74-b8c4-0689d7c0d048 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:25.745438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035f6cb-485c-4f74-b8c4-0689d7c0d048 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:25.745813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035f6cb-485c-4f74-b8c4-0689d7c0d048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:25.769065 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:25.838961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e035f6cb-485c-4f74-b8c4-0689d7c0d048 None None] MFA Rules not processed for user `2f985626d8af4f3089e72998fad98b47`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:25.840472 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e035f6cb-485c-4f74-b8c4-0689d7c0d048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:25.969603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 675/1359] 10.222.0.107 () {58 vars in 1064 bytes} [Tue Aug 23 23:17:25 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:25.978041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f814e9c-1ad3-45b2-a2ed-1fe507468c2b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:25.979851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9f814e9c-1ad3-45b2-a2ed-1fe507468c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:26.140229 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f814e9c-1ad3-45b2-a2ed-1fe507468c2b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:26.219548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:26.262551 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab55fc-11d8-4da5-b7d0-5e310367b7a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:26.263225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab55fc-11d8-4da5-b7d0-5e310367b7a0 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:26.263596 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab55fc-11d8-4da5-b7d0-5e310367b7a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:26.263960 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab55fc-11d8-4da5-b7d0-5e310367b7a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:26.265696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9cab55fc-11d8-4da5-b7d0-5e310367b7a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:26.360886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab55fc-11d8-4da5-b7d0-5e310367b7a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:26.363190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab55fc-11d8-4da5-b7d0-5e310367b7a0 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:26.386176 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 685/1360] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:17:25 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:17:28.581903 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f2c26-c853-41cf-aac4-e575782931b7 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:28.582430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f2c26-c853-41cf-aac4-e575782931b7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:28.582430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f2c26-c853-41cf-aac4-e575782931b7 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:28.583867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 676/1361] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:17:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:28.589785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52bea4-6d6b-472b-9b2c-dab3fd05d0e8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:28.590316 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52bea4-6d6b-472b-9b2c-dab3fd05d0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:28.590316 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52bea4-6d6b-472b-9b2c-dab3fd05d0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:28.663981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6d52bea4-6d6b-472b-9b2c-dab3fd05d0e8 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:28.665801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6d52bea4-6d6b-472b-9b2c-dab3fd05d0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:28.709720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:28.803647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 686/1362] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:17:28 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:29.119080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f2c26-c853-41cf-aac4-e575782931b7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:29.120669 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e91f2c26-c853-41cf-aac4-e575782931b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:29.201620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:29.304252 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f2c26-c853-41cf-aac4-e575782931b7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:29.440737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5fb41-f2e1-4c65-856a-26447b5aeee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:29.441343 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5fb41-f2e1-4c65-856a-26447b5aeee2 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:29.441617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5fb41-f2e1-4c65-856a-26447b5aeee2 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:29.441883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5fb41-f2e1-4c65-856a-26447b5aeee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:29.443511 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-77f5fb41-f2e1-4c65-856a-26447b5aeee2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:29.472915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:29.572482 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5fb41-f2e1-4c65-856a-26447b5aeee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:29.572657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5fb41-f2e1-4c65-856a-26447b5aeee2 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:29.596851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 677/1363] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:17:29 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:17:31.927894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036f9e5-6f6f-4dfe-8995-4f83e886c604 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:31.928864 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036f9e5-6f6f-4dfe-8995-4f83e886c604 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:31.928864 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036f9e5-6f6f-4dfe-8995-4f83e886c604 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:31.930067 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 687/1364] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:17:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:31.936652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff28f5-18cf-417f-8205-56f1bce0ecf8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:31.937383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff28f5-18cf-417f-8205-56f1bce0ecf8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:31.937766 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff28f5-18cf-417f-8205-56f1bce0ecf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:32.012642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1bff28f5-18cf-417f-8205-56f1bce0ecf8 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:32.014023 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1bff28f5-18cf-417f-8205-56f1bce0ecf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:32.123357 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:32.133242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 678/1365] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:17:31 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:32.423264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dea8b-fa8d-4acc-83d8-41c5df8bb049 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:32.423565 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dea8b-fa8d-4acc-83d8-41c5df8bb049 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:32.423815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dea8b-fa8d-4acc-83d8-41c5df8bb049 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:32.425650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 688/1366] 10.222.0.107 () {54 vars in 967 bytes} [Tue Aug 23 23:17:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:32.431922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ff187-d094-4a41-becd-620a07c941eb None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:32.432380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ff187-d094-4a41-becd-620a07c941eb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:32.432788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ff187-d094-4a41-becd-620a07c941eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:32.513274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-475ff187-d094-4a41-becd-620a07c941eb None None] MFA Rules not processed for user `2f985626d8af4f3089e72998fad98b47`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:32.514643 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-475ff187-d094-4a41-becd-620a07c941eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:32.644928 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 679/1367] 10.222.0.107 () {58 vars in 1064 bytes} [Tue Aug 23 23:17:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:32.653900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dea8b-fa8d-4acc-83d8-41c5df8bb049 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:32.655562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ac4dea8b-fa8d-4acc-83d8-41c5df8bb049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:32.826301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dea8b-fa8d-4acc-83d8-41c5df8bb049 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:32.849150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:32.956718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995bcbb-c2b8-4156-aad3-ba26796b9411 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:32.957477 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995bcbb-c2b8-4156-aad3-ba26796b9411 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:32.957855 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995bcbb-c2b8-4156-aad3-ba26796b9411 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:32.958230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995bcbb-c2b8-4156-aad3-ba26796b9411 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:32.959931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9995bcbb-c2b8-4156-aad3-ba26796b9411 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:33.077517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995bcbb-c2b8-4156-aad3-ba26796b9411 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:33.079268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995bcbb-c2b8-4156-aad3-ba26796b9411 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:33.099712 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 689/1368] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:17:32 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:17:33.623690 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43158167-ce54-411c-a75e-e235e246fa70 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:33.624237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43158167-ce54-411c-a75e-e235e246fa70 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:33.624237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43158167-ce54-411c-a75e-e235e246fa70 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:33.625759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 680/1369] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:17:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:33.631088 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071906d-4caa-45a5-8d9a-6d4c447dd6d2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:33.631373 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071906d-4caa-45a5-8d9a-6d4c447dd6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:33.631648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071906d-4caa-45a5-8d9a-6d4c447dd6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:33.666760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:33.705009 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d071906d-4caa-45a5-8d9a-6d4c447dd6d2 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:33.706221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d071906d-4caa-45a5-8d9a-6d4c447dd6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:33.822177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 690/1370] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:17:33 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:34.436487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec959d-d293-444e-a6ec-dbb79e14e3c7 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:34.436922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec959d-d293-444e-a6ec-dbb79e14e3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:34.437301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec959d-d293-444e-a6ec-dbb79e14e3c7 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:34.438874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 681/1371] 10.222.0.107 () {54 vars in 969 bytes} [Tue Aug 23 23:17:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:34.443682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6666729-c2d4-4ef7-b44d-9daffb492bd2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:34.444289 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6666729-c2d4-4ef7-b44d-9daffb492bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:34.444394 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6666729-c2d4-4ef7-b44d-9daffb492bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:34.527063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d6666729-c2d4-4ef7-b44d-9daffb492bd2 None None] MFA Rules not processed for user `8937ae9f5c7840a2a5af5f851d02ea77`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:34.528587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d6666729-c2d4-4ef7-b44d-9daffb492bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:34.582899 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:34.618329 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 691/1372] 10.222.0.107 () {58 vars in 1066 bytes} [Tue Aug 23 23:17:34 2022] POST /identity/v3/auth/tokens => generated 3130 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:34.626067 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec959d-d293-444e-a6ec-dbb79e14e3c7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:34.628165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d8ec959d-d293-444e-a6ec-dbb79e14e3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:34.682653 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:34.742139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec959d-d293-444e-a6ec-dbb79e14e3c7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:34.826856 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd3f68-4d7c-4e04-b95a-1020a096a88c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8937ae9f5c7840a2a5af5f851d02ea77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:34.827859 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd3f68-4d7c-4e04-b95a-1020a096a88c service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:34.828294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd3f68-4d7c-4e04-b95a-1020a096a88c service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:34.828757 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd3f68-4d7c-4e04-b95a-1020a096a88c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:34.830594 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-41cd3f68-4d7c-4e04-b95a-1020a096a88c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:34.945231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:34.961727 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd3f68-4d7c-4e04-b95a-1020a096a88c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:34.963190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd3f68-4d7c-4e04-b95a-1020a096a88c service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:34.983711 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 682/1373] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:17:34 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:17:35.091985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5197a-760e-4e44-aa2c-f6b8fe9d92f9 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:35.092259 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5197a-760e-4e44-aa2c-f6b8fe9d92f9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:35.092534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5197a-760e-4e44-aa2c-f6b8fe9d92f9 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:35.095109 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 692/1374] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:17:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:35.100656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff743f0b-1791-40fc-aeba-08e371268e60 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:35.101183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff743f0b-1791-40fc-aeba-08e371268e60 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:35.101475 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff743f0b-1791-40fc-aeba-08e371268e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:35.187774 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ff743f0b-1791-40fc-aeba-08e371268e60 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:35.189450 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ff743f0b-1791-40fc-aeba-08e371268e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:35.308189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 683/1375] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:17:35 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:35.600873 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5197a-760e-4e44-aa2c-f6b8fe9d92f9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:35.602509 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b0e5197a-760e-4e44-aa2c-f6b8fe9d92f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:35.763751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5197a-760e-4e44-aa2c-f6b8fe9d92f9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:35.820533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:35.884727 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339e3fd-e197-4881-9f67-fd65f3c2b684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:35.885244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339e3fd-e197-4881-9f67-fd65f3c2b684 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:35.885521 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339e3fd-e197-4881-9f67-fd65f3c2b684 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:35.885789 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339e3fd-e197-4881-9f67-fd65f3c2b684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:35.887442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9339e3fd-e197-4881-9f67-fd65f3c2b684 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:35.987577 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339e3fd-e197-4881-9f67-fd65f3c2b684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:35.989295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339e3fd-e197-4881-9f67-fd65f3c2b684 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:36.010629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 693/1376] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:17:35 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:17:37.991532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b0563-4458-4c11-91bb-f55380b8e814 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:37.992097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b0563-4458-4c11-91bb-f55380b8e814 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:37.992097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b0563-4458-4c11-91bb-f55380b8e814 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:37.993636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 684/1377] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:17:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:37.999365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82f163-98bd-4004-ae70-2b071b7b7023 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:37.999816 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82f163-98bd-4004-ae70-2b071b7b7023 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:37.999906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82f163-98bd-4004-ae70-2b071b7b7023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:38.097636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1b82f163-98bd-4004-ae70-2b071b7b7023 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:38.098985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1b82f163-98bd-4004-ae70-2b071b7b7023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:38.106099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:38.230718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 694/1378] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:17:37 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:38.529021 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b0563-4458-4c11-91bb-f55380b8e814 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:38.530530 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9c2b0563-4458-4c11-91bb-f55380b8e814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:38.615852 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:38.736982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b0563-4458-4c11-91bb-f55380b8e814 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:38.865722 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de256db-6ef2-4a20-91c9-86fc833310a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:38.866239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de256db-6ef2-4a20-91c9-86fc833310a5 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:38.866509 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de256db-6ef2-4a20-91c9-86fc833310a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:38.866775 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de256db-6ef2-4a20-91c9-86fc833310a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:38.869095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6de256db-6ef2-4a20-91c9-86fc833310a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:38.888733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:38.967691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de256db-6ef2-4a20-91c9-86fc833310a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:38.969326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de256db-6ef2-4a20-91c9-86fc833310a5 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:38.989460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 685/1379] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:17:38 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:17:41.103808 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890946e1-fd7f-4633-8fba-d4801e6d48eb None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:41.104343 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890946e1-fd7f-4633-8fba-d4801e6d48eb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:41.104343 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890946e1-fd7f-4633-8fba-d4801e6d48eb None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:41.105877 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 695/1380] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:17:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:41.111109 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5b841-f787-4489-a6dd-d4521e597beb None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:41.111515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5b841-f787-4489-a6dd-d4521e597beb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:41.111732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5b841-f787-4489-a6dd-d4521e597beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:41.189535 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d5b5b841-f787-4489-a6dd-d4521e597beb None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:41.190752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d5b5b841-f787-4489-a6dd-d4521e597beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:41.291301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:41.298407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 686/1381] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:17:41 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:41.588392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890946e1-fd7f-4633-8fba-d4801e6d48eb None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:41.590174 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-890946e1-fd7f-4633-8fba-d4801e6d48eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:41.761979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:41.775185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890946e1-fd7f-4633-8fba-d4801e6d48eb None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:41.901472 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de92713-f152-4ad3-a204-d00146ed82c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:41.901999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de92713-f152-4ad3-a204-d00146ed82c9 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:41.902274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de92713-f152-4ad3-a204-d00146ed82c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:41.902538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de92713-f152-4ad3-a204-d00146ed82c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:41.904124 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9de92713-f152-4ad3-a204-d00146ed82c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:42.018916 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de92713-f152-4ad3-a204-d00146ed82c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:42.020705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de92713-f152-4ad3-a204-d00146ed82c9 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:42.036792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:42.052523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 696/1382] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:17:41 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:17:44.189617 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc497e1-3759-4b00-89fd-0f0530b92914 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:44.190151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc497e1-3759-4b00-89fd-0f0530b92914 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:44.190151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc497e1-3759-4b00-89fd-0f0530b92914 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:44.191518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 687/1383] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:17:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:44.197394 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba05683-27b2-4824-9f50-db5412f72648 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:44.197879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba05683-27b2-4824-9f50-db5412f72648 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:44.197974 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba05683-27b2-4824-9f50-db5412f72648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:44.271523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cba05683-27b2-4824-9f50-db5412f72648 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:44.272941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cba05683-27b2-4824-9f50-db5412f72648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:44.388370 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 697/1384] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:17:44 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:44.687294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc497e1-3759-4b00-89fd-0f0530b92914 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:44.688876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ffc497e1-3759-4b00-89fd-0f0530b92914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:44.865079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc497e1-3759-4b00-89fd-0f0530b92914 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:44.937197 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:44.990185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcba15-1477-432e-a8dd-4ea6d5be02f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:44.990895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcba15-1477-432e-a8dd-4ea6d5be02f6 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:44.991264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcba15-1477-432e-a8dd-4ea6d5be02f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:44.991582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcba15-1477-432e-a8dd-4ea6d5be02f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:44.994444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4edcba15-1477-432e-a8dd-4ea6d5be02f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:45.117903 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcba15-1477-432e-a8dd-4ea6d5be02f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:45.119728 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcba15-1477-432e-a8dd-4ea6d5be02f6 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:45.141025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 688/1385] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:17:44 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:17:47.114875 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aacee9-9427-49bc-9a41-83978d5369b8 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:47.115612 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aacee9-9427-49bc-9a41-83978d5369b8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:47.115612 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aacee9-9427-49bc-9a41-83978d5369b8 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:47.117782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 698/1386] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:17:47 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:47.125531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374eb68-2522-4cea-87d6-f75299bc6520 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:47.126225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374eb68-2522-4cea-87d6-f75299bc6520 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:47.126225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374eb68-2522-4cea-87d6-f75299bc6520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:47.219405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2374eb68-2522-4cea-87d6-f75299bc6520 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:47.221264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2374eb68-2522-4cea-87d6-f75299bc6520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:47.263815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:47.334598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 689/1387] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:17:47 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:17:47.762389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aacee9-9427-49bc-9a41-83978d5369b8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:47.764651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-10aacee9-9427-49bc-9a41-83978d5369b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:47.874689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:47.976341 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aacee9-9427-49bc-9a41-83978d5369b8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:48.134244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63617970-b9ce-4a17-8857-c9a9904d9569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:48.134958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63617970-b9ce-4a17-8857-c9a9904d9569 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:48.135286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63617970-b9ce-4a17-8857-c9a9904d9569 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:48.135608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63617970-b9ce-4a17-8857-c9a9904d9569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:48.137538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-63617970-b9ce-4a17-8857-c9a9904d9569 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:48.190290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:48.254081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63617970-b9ce-4a17-8857-c9a9904d9569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:48.255643 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63617970-b9ce-4a17-8857-c9a9904d9569 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:48.274788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 699/1388] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:17:47 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:17:50.277127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81040ba-3355-426e-9327-cecbe35809c1 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:50.277650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81040ba-3355-426e-9327-cecbe35809c1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:50.277650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81040ba-3355-426e-9327-cecbe35809c1 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:50.278918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 690/1389] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:17:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:17:50.284294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a493-a996-4738-bc67-68d4209e7ebe None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:50.284762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a493-a996-4738-bc67-68d4209e7ebe None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:50.284857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a493-a996-4738-bc67-68d4209e7ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:50.357239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f0b8a493-a996-4738-bc67-68d4209e7ebe None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:50.358489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f0b8a493-a996-4738-bc67-68d4209e7ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:50.418692 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecaeaf-f6ce-4a9e-aae9-7a826e7e2c9b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:50.418980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecaeaf-f6ce-4a9e-aae9-7a826e7e2c9b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:50.419255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecaeaf-f6ce-4a9e-aae9-7a826e7e2c9b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:50.420618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 691/1390] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:17:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:50.425732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72426a9-f8f0-4e6c-9c0d-4eb1819c399e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:50.426014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72426a9-f8f0-4e6c-9c0d-4eb1819c399e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:50.426291 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72426a9-f8f0-4e6c-9c0d-4eb1819c399e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:50.458385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 700/1391] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:17:50 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:50.493317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a72426a9-f8f0-4e6c-9c0d-4eb1819c399e None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:50.494545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a72426a9-f8f0-4e6c-9c0d-4eb1819c399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:50.592406 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 692/1392] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:17:50 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:17:50.755820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a493-a996-4738-bc67-68d4209e7ebe None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:50.757619 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f0b8a493-a996-4738-bc67-68d4209e7ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:50.771226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:50.873933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a493-a996-4738-bc67-68d4209e7ebe None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:50.899154 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417324ee-da3d-42f5-a312-2429038a5be1 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:50.899439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417324ee-da3d-42f5-a312-2429038a5be1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:50.899713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417324ee-da3d-42f5-a312-2429038a5be1 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:50.901113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 693/1393] 10.222.0.107 () {54 vars in 972 bytes} [Tue Aug 23 23:17:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:50.906255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a1feb-ac04-4f98-9489-4b54b9f6d878 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:50.906538 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a1feb-ac04-4f98-9489-4b54b9f6d878 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:50.906810 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a1feb-ac04-4f98-9489-4b54b9f6d878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:50.923186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:50.995003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-635a1feb-ac04-4f98-9489-4b54b9f6d878 None None] MFA Rules not processed for user `a43ac193836248959a0380a76549ec10`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:50.995003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-635a1feb-ac04-4f98-9489-4b54b9f6d878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:50.998409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8250fb-a06f-4db1-b50a-5942b2987f9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:50.999022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8250fb-a06f-4db1-b50a-5942b2987f9e service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:50.999296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8250fb-a06f-4db1-b50a-5942b2987f9e service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:50.999561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8250fb-a06f-4db1-b50a-5942b2987f9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:51.001247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8d8250fb-a06f-4db1-b50a-5942b2987f9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:51.010642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:51.078338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 694/1394] 10.222.0.107 () {58 vars in 1069 bytes} [Tue Aug 23 23:17:50 2022] POST /identity/v3/auth/tokens => generated 3130 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:17:51.086839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a1feb-ac04-4f98-9489-4b54b9f6d878 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:51.094645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a1feb-ac04-4f98-9489-4b54b9f6d878 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:51.098488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8250fb-a06f-4db1-b50a-5942b2987f9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:51.100082 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8250fb-a06f-4db1-b50a-5942b2987f9e service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:51.121034 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 701/1395] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:17:50 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:17:51.182980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f5a40-7d8c-4b7d-8f36-3a6754af3366 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43ac193836248959a0380a76549ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:51.183585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f5a40-7d8c-4b7d-8f36-3a6754af3366 service glance] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:51.183918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f5a40-7d8c-4b7d-8f36-3a6754af3366 service glance] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:51.184201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f5a40-7d8c-4b7d-8f36-3a6754af3366 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:51.185928 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5c8f5a40-7d8c-4b7d-8f36-3a6754af3366 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:51.221127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:51.321407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f5a40-7d8c-4b7d-8f36-3a6754af3366 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:51.323008 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f5a40-7d8c-4b7d-8f36-3a6754af3366 service glance] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:51.342227 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 695/1396] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:17:51 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:17:52.100069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65809c3-e97b-4897-977d-07e334a43049 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:52.100669 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65809c3-e97b-4897-977d-07e334a43049 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:52.100669 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65809c3-e97b-4897-977d-07e334a43049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:52.180950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c65809c3-e97b-4897-977d-07e334a43049 None None] MFA Rules not processed for user `238ad0efedfd4cd89d99e2abebaeba63`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:52.182153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c65809c3-e97b-4897-977d-07e334a43049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:52.276805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:52.283918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 702/1397] 10.222.0.107 () {58 vars in 1014 bytes} [Tue Aug 23 23:17:52 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:52.323688 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7b5d4-b204-4470-a1b5-e1a6739ee03c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:52.324176 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7b5d4-b204-4470-a1b5-e1a6739ee03c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:52.324286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7b5d4-b204-4470-a1b5-e1a6739ee03c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:52.325621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 696/1398] 10.222.0.107 () {54 vars in 948 bytes} [Tue Aug 23 23:17:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:52.331750 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbb9bc-9189-480a-be80-759f39f23b86 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:52.332058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbb9bc-9189-480a-be80-759f39f23b86 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:52.332346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbb9bc-9189-480a-be80-759f39f23b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:52.409205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-84fbb9bc-9189-480a-be80-759f39f23b86 None None] MFA Rules not processed for user `35d0b95b22bc4117957cbc3afa5547a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:52.410327 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-84fbb9bc-9189-480a-be80-759f39f23b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:52.517625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 703/1399] 10.222.0.107 () {58 vars in 1045 bytes} [Tue Aug 23 23:17:52 2022] POST /identity/v3/auth/tokens => generated 3314 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:52.527890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7b5d4-b204-4470-a1b5-e1a6739ee03c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:52.529523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d7a7b5d4-b204-4470-a1b5-e1a6739ee03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:52.671009 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:52.673566 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7b5d4-b204-4470-a1b5-e1a6739ee03c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:52.783298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63269eb7-ef6c-4ce1-b956-39d8d484f61c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d0b95b22bc4117957cbc3afa5547a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:52.783903 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63269eb7-ef6c-4ce1-b956-39d8d484f61c service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:52.784182 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63269eb7-ef6c-4ce1-b956-39d8d484f61c service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:52.784453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63269eb7-ef6c-4ce1-b956-39d8d484f61c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:52.786142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-63269eb7-ef6c-4ce1-b956-39d8d484f61c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:52.873314 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63269eb7-ef6c-4ce1-b956-39d8d484f61c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:52.874933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63269eb7-ef6c-4ce1-b956-39d8d484f61c service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:52.884097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 697/1400] 10.222.0.107 () {60 vars in 1389 bytes} [Tue Aug 23 23:17:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:17:53.113546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40659c09-2f44-4fde-b0a0-b267230a6621 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:53.114076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40659c09-2f44-4fde-b0a0-b267230a6621 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:53.114076 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40659c09-2f44-4fde-b0a0-b267230a6621 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:53.115579 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 704/1401] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:17:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:53.121760 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14033e7d-a51e-4ec5-b3c7-0a856c6b6117 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:53.122046 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14033e7d-a51e-4ec5-b3c7-0a856c6b6117 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:53.122316 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14033e7d-a51e-4ec5-b3c7-0a856c6b6117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:53.163264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:53.200949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-14033e7d-a51e-4ec5-b3c7-0a856c6b6117 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:53.202113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-14033e7d-a51e-4ec5-b3c7-0a856c6b6117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:53.323098 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 698/1402] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:17:53 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:53.616903 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40659c09-2f44-4fde-b0a0-b267230a6621 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:53.618427 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-40659c09-2f44-4fde-b0a0-b267230a6621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:53.692641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:53.798880 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40659c09-2f44-4fde-b0a0-b267230a6621 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:53.930488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff80ab5-bf9b-435d-aeff-d2d1917db796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:53.931143 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff80ab5-bf9b-435d-aeff-d2d1917db796 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:53.931422 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff80ab5-bf9b-435d-aeff-d2d1917db796 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:53.931691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff80ab5-bf9b-435d-aeff-d2d1917db796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:53.933374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-aff80ab5-bf9b-435d-aeff-d2d1917db796 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:53.956152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:54.042447 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff80ab5-bf9b-435d-aeff-d2d1917db796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:54.044061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff80ab5-bf9b-435d-aeff-d2d1917db796 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:54.068976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 705/1403] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:17:53 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:17:56.084228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1102e-a0f5-41e9-aa54-cf11b9abe06d None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:56.085473 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1102e-a0f5-41e9-aa54-cf11b9abe06d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:56.085473 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1102e-a0f5-41e9-aa54-cf11b9abe06d None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:56.086889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 699/1404] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:17:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:56.092465 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927caf4-c7b2-4c68-90b0-d242110b2b9f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:56.092971 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927caf4-c7b2-4c68-90b0-d242110b2b9f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:56.093071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927caf4-c7b2-4c68-90b0-d242110b2b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:56.170376 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0927caf4-c7b2-4c68-90b0-d242110b2b9f None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:56.171627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0927caf4-c7b2-4c68-90b0-d242110b2b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:56.277936 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:56.290031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 706/1405] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:17:56 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:56.596390 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1102e-a0f5-41e9-aa54-cf11b9abe06d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:56.598612 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d0b1102e-a0f5-41e9-aa54-cf11b9abe06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:56.742245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:56.791905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1102e-a0f5-41e9-aa54-cf11b9abe06d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:56.915676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad3015-76d9-4883-8427-b94921cd985d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:56.916167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad3015-76d9-4883-8427-b94921cd985d service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:56.916458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad3015-76d9-4883-8427-b94921cd985d service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:56.916772 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad3015-76d9-4883-8427-b94921cd985d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:56.918443 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-08ad3015-76d9-4883-8427-b94921cd985d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:57.008623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:57.032080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad3015-76d9-4883-8427-b94921cd985d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:57.034099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad3015-76d9-4883-8427-b94921cd985d service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:57.058069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 700/1406] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:17:56 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:17:59.049685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fe30b-1733-4908-ad43-1c4bd670eaa4 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:59.050244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fe30b-1733-4908-ad43-1c4bd670eaa4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:59.050244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fe30b-1733-4908-ad43-1c4bd670eaa4 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:59.051575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 707/1407] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:17:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:17:59.057234 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5af111-87f2-47cd-980c-358ca7a7a424 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:59.057744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5af111-87f2-47cd-980c-358ca7a7a424 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:59.057832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5af111-87f2-47cd-980c-358ca7a7a424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:59.132503 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8e5af111-87f2-47cd-980c-358ca7a7a424 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:59.133820 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8e5af111-87f2-47cd-980c-358ca7a7a424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:59.244194 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 701/1408] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:17:59 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:59.540509 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fe30b-1733-4908-ad43-1c4bd670eaa4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:59.544696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9a3fe30b-1733-4908-ad43-1c4bd670eaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:59.717134 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fe30b-1733-4908-ad43-1c4bd670eaa4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:59.793578 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:59.847138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fb780-8967-4304-a3de-b39374c6fc70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:59.847748 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fb780-8967-4304-a3de-b39374c6fc70 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:59.848026 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fb780-8967-4304-a3de-b39374c6fc70 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:59.848297 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fb780-8967-4304-a3de-b39374c6fc70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:59.850080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-016fb780-8967-4304-a3de-b39374c6fc70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:59.996186 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fb780-8967-4304-a3de-b39374c6fc70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:59.997908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fb780-8967-4304-a3de-b39374c6fc70 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:00.020800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 708/1409] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:17:59 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:09.242015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=79 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:10.017150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=64 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:15.539530 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862ae54-dba7-4053-84dd-33ed67e9e56c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:15.540243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862ae54-dba7-4053-84dd-33ed67e9e56c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:15.540243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862ae54-dba7-4053-84dd-33ed67e9e56c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:15.541489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 702/1410] 10.222.0.107 () {54 vars in 923 bytes} [Tue Aug 23 23:18:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:15.546533 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5e523-dbd8-4bd0-be58-eb5dbfe7153c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:15.546937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5e523-dbd8-4bd0-be58-eb5dbfe7153c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:15.547082 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5e523-dbd8-4bd0-be58-eb5dbfe7153c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:15.624003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-bef5e523-dbd8-4bd0-be58-eb5dbfe7153c None None] MFA Rules not processed for user `14ee6ffc0985405193735af49a398326`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:15.625282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bef5e523-dbd8-4bd0-be58-eb5dbfe7153c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:15.735137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 709/1411] 10.222.0.107 () {58 vars in 1020 bytes} [Tue Aug 23 23:18:15 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:15.750389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d1533-aed9-48fd-a89e-72bb3210e538 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:15.750675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d1533-aed9-48fd-a89e-72bb3210e538 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:15.750946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d1533-aed9-48fd-a89e-72bb3210e538 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:15.752305 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 703/1412] 10.222.0.107 () {54 vars in 923 bytes} [Tue Aug 23 23:18:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:15.758344 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65f53c-c24d-48d8-b184-af94ae78149d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:15.758624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65f53c-c24d-48d8-b184-af94ae78149d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:15.758900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65f53c-c24d-48d8-b184-af94ae78149d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:15.839706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:15.842895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9d65f53c-c24d-48d8-b184-af94ae78149d None None] MFA Rules not processed for user `2f985626d8af4f3089e72998fad98b47`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:15.844719 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9d65f53c-c24d-48d8-b184-af94ae78149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:15.960694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 710/1413] 10.222.0.107 () {58 vars in 1020 bytes} [Tue Aug 23 23:18:15 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:18.387785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d071d9a-4181-4c02-9d69-6e4f560c46c7 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:18.388301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d071d9a-4181-4c02-9d69-6e4f560c46c7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:18.388301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d071d9a-4181-4c02-9d69-6e4f560c46c7 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:18.389616 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:18:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:18.395164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421a8b3-e4f6-485d-8939-bb2c7aa4ece2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:18.395646 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421a8b3-e4f6-485d-8939-bb2c7aa4ece2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:18.395864 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421a8b3-e4f6-485d-8939-bb2c7aa4ece2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:18.464418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e421a8b3-e4f6-485d-8939-bb2c7aa4ece2 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:18.465574 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e421a8b3-e4f6-485d-8939-bb2c7aa4ece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:18.520738 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:18.563992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:18:18 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:18.852993 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d071d9a-4181-4c02-9d69-6e4f560c46c7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:18.854585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1d071d9a-4181-4c02-9d69-6e4f560c46c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:18.998312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d071d9a-4181-4c02-9d69-6e4f560c46c7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:19.072580 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:19.114277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b09aa6-1bc3-4598-90ae-7e938290784d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:19.114881 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b09aa6-1bc3-4598-90ae-7e938290784d service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:19.115163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b09aa6-1bc3-4598-90ae-7e938290784d service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:19.115438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b09aa6-1bc3-4598-90ae-7e938290784d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:19.117095 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b0b09aa6-1bc3-4598-90ae-7e938290784d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:19.206409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b09aa6-1bc3-4598-90ae-7e938290784d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:19.208655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b09aa6-1bc3-4598-90ae-7e938290784d service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:19.226758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 705/1416] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:18 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:20.139741 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756d2ba-ce6f-45cb-a315-b1f66efa47fd None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:20.140294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756d2ba-ce6f-45cb-a315-b1f66efa47fd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:20.140294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756d2ba-ce6f-45cb-a315-b1f66efa47fd None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:20.141654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:18:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:20.146816 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421ad70-1d3b-42df-8e8a-0065fd174750 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:20.147276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421ad70-1d3b-42df-8e8a-0065fd174750 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:20.147382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421ad70-1d3b-42df-8e8a-0065fd174750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:20.225194 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9421ad70-1d3b-42df-8e8a-0065fd174750 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:20.226400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9421ad70-1d3b-42df-8e8a-0065fd174750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:20.253214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:20.324707 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:18:20 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:20.494167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756d2ba-ce6f-45cb-a315-b1f66efa47fd None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:20.495766 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1756d2ba-ce6f-45cb-a315-b1f66efa47fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:20.651437 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756d2ba-ce6f-45cb-a315-b1f66efa47fd None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:20.692691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:20.766308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028af063-e726-451e-b692-b4766caddbc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:20.766933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028af063-e726-451e-b692-b4766caddbc8 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:20.767213 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028af063-e726-451e-b692-b4766caddbc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:20.767480 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028af063-e726-451e-b692-b4766caddbc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:20.769174 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-028af063-e726-451e-b692-b4766caddbc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:20.858478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028af063-e726-451e-b692-b4766caddbc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:20.860070 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028af063-e726-451e-b692-b4766caddbc8 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:20.877651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 713/1419] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:20 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:21.771034 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa1c8c-749d-4c85-b93c-5ef6c605063f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:21.771611 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa1c8c-749d-4c85-b93c-5ef6c605063f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:21.771611 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa1c8c-749d-4c85-b93c-5ef6c605063f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:21.772927 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:18:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:18:21.777893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd35e72-6686-45ff-a7a3-76824d44356b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:21.778295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd35e72-6686-45ff-a7a3-76824d44356b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:21.778544 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd35e72-6686-45ff-a7a3-76824d44356b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:21.833318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:21.857272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6fd35e72-6686-45ff-a7a3-76824d44356b None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:21.858488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6fd35e72-6686-45ff-a7a3-76824d44356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:21.953730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:18:21 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:22.105792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa1c8c-749d-4c85-b93c-5ef6c605063f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:22.107366 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-78fa1c8c-749d-4c85-b93c-5ef6c605063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:22.255243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa1c8c-749d-4c85-b93c-5ef6c605063f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:22.267405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:22.370388 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a31b5-7d26-4cb0-bb2f-04c7edc04b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:22.370907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a31b5-7d26-4cb0-bb2f-04c7edc04b2d service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:22.371187 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a31b5-7d26-4cb0-bb2f-04c7edc04b2d service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:22.371462 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a31b5-7d26-4cb0-bb2f-04c7edc04b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:22.373114 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d19a31b5-7d26-4cb0-bb2f-04c7edc04b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:22.475374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a31b5-7d26-4cb0-bb2f-04c7edc04b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:22.477033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a31b5-7d26-4cb0-bb2f-04c7edc04b2d service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:22.495680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 708/1422] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:22 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:23.373602 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b4948-7e46-4567-b8d4-ab4f574ba207 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:23.374171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b4948-7e46-4567-b8d4-ab4f574ba207 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:23.374321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b4948-7e46-4567-b8d4-ab4f574ba207 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:23.375745 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:18:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:23.381353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a054e-a93d-47e3-8b88-14ba448fc6ea None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:23.381800 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a054e-a93d-47e3-8b88-14ba448fc6ea None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:23.381909 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a054e-a93d-47e3-8b88-14ba448fc6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:23.402085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:23.460968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-950a054e-a93d-47e3-8b88-14ba448fc6ea None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:23.462200 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-950a054e-a93d-47e3-8b88-14ba448fc6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:23.559710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:18:23 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:23.712078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b4948-7e46-4567-b8d4-ab4f574ba207 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:23.713635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-543b4948-7e46-4567-b8d4-ab4f574ba207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:23.825704 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:23.861487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b4948-7e46-4567-b8d4-ab4f574ba207 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:23.973730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaf476-c9e1-46d5-947e-d2e7deebd915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:23.974253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaf476-c9e1-46d5-947e-d2e7deebd915 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:23.974531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaf476-c9e1-46d5-947e-d2e7deebd915 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:23.974794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaf476-c9e1-46d5-947e-d2e7deebd915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:23.976415 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-23aaf476-c9e1-46d5-947e-d2e7deebd915 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:24.055570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:24.070791 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaf476-c9e1-46d5-947e-d2e7deebd915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:24.072400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaf476-c9e1-46d5-947e-d2e7deebd915 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:24.091782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 716/1425] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:23 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:24.959561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7e06f-5f23-44da-8758-1e71092b325b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:24.960105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7e06f-5f23-44da-8758-1e71092b325b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:24.960225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7e06f-5f23-44da-8758-1e71092b325b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:24.961514 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:18:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:24.966482 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2c940-3f78-4877-b97b-24a89ab4c5ef None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:24.966919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2c940-3f78-4877-b97b-24a89ab4c5ef None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:24.967018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2c940-3f78-4877-b97b-24a89ab4c5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:25.043956 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-38a2c940-3f78-4877-b97b-24a89ab4c5ef None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:25.045203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-38a2c940-3f78-4877-b97b-24a89ab4c5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:25.142997 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:18:24 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:25.295519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7e06f-5f23-44da-8758-1e71092b325b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:25.297011 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d7c7e06f-5f23-44da-8758-1e71092b325b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:25.382879 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:25.445687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7e06f-5f23-44da-8758-1e71092b325b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:25.558676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4b9eb-ff31-4aa1-a452-fc4a69078f46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:25.559189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4b9eb-ff31-4aa1-a452-fc4a69078f46 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:25.559462 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4b9eb-ff31-4aa1-a452-fc4a69078f46 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:25.559728 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4b9eb-ff31-4aa1-a452-fc4a69078f46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:25.561354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-62b4b9eb-ff31-4aa1-a452-fc4a69078f46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:25.609752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:25.651656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4b9eb-ff31-4aa1-a452-fc4a69078f46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:25.653309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4b9eb-ff31-4aa1-a452-fc4a69078f46 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:25.672297 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 711/1428] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:25 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:26.482490 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06757e-9255-47f5-a6e8-ff44215193f7 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:26.483099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06757e-9255-47f5-a6e8-ff44215193f7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:26.483099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06757e-9255-47f5-a6e8-ff44215193f7 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:26.484385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:18:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:26.490763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1c258-b795-4987-9b54-1fe7b725af1b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:26.491229 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1c258-b795-4987-9b54-1fe7b725af1b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:26.491333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1c258-b795-4987-9b54-1fe7b725af1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:26.570058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-76f1c258-b795-4987-9b54-1fe7b725af1b None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:26.571254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-76f1c258-b795-4987-9b54-1fe7b725af1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:26.668986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:18:26 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:26.822751 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06757e-9255-47f5-a6e8-ff44215193f7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:26.824208 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5b06757e-9255-47f5-a6e8-ff44215193f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:26.872351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:26.970924 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06757e-9255-47f5-a6e8-ff44215193f7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:27.087470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4feef07-74b2-427b-8434-ba72d7dd9f95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:27.087988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feef07-74b2-427b-8434-ba72d7dd9f95 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:27.088258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feef07-74b2-427b-8434-ba72d7dd9f95 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:27.088519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feef07-74b2-427b-8434-ba72d7dd9f95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:27.090138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c4feef07-74b2-427b-8434-ba72d7dd9f95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:27.097254 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:27.185176 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4feef07-74b2-427b-8434-ba72d7dd9f95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:27.186775 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4feef07-74b2-427b-8434-ba72d7dd9f95 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:27.205479 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 719/1431] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:26 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:28.020724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e9005-287e-4124-aeb0-3afe296807f0 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:28.021229 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e9005-287e-4124-aeb0-3afe296807f0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:28.021351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e9005-287e-4124-aeb0-3afe296807f0 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:28.022597 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:18:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:28.027649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277f59c-1805-4512-91e6-e44136e3e360 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:28.028100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277f59c-1805-4512-91e6-e44136e3e360 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:28.028230 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277f59c-1805-4512-91e6-e44136e3e360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:28.106985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b277f59c-1805-4512-91e6-e44136e3e360 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:28.108221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b277f59c-1805-4512-91e6-e44136e3e360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:28.179793 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:28.209025 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:18:28 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:28.359899 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e9005-287e-4124-aeb0-3afe296807f0 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:28.361371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-528e9005-287e-4124-aeb0-3afe296807f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:28.379960 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:28.507487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e9005-287e-4124-aeb0-3afe296807f0 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:28.608734 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:28.635140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f514d-45f7-494f-af2a-094164fb3956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:28.635666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f514d-45f7-494f-af2a-094164fb3956 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:28.635938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f514d-45f7-494f-af2a-094164fb3956 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:28.636202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f514d-45f7-494f-af2a-094164fb3956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:28.637843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a66f514d-45f7-494f-af2a-094164fb3956 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:28.732608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f514d-45f7-494f-af2a-094164fb3956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:28.734400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f514d-45f7-494f-af2a-094164fb3956 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:28.754678 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 714/1434] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:28 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:29.574825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740b7c2-bb1b-4831-9225-b6c4e687e06f None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:29.575403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740b7c2-bb1b-4831-9225-b6c4e687e06f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:29.575403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740b7c2-bb1b-4831-9225-b6c4e687e06f None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:29.576747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:18:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:29.582845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabd5c9-c83b-417c-b8c7-0244c26bcce8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:29.583553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabd5c9-c83b-417c-b8c7-0244c26bcce8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:29.583553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabd5c9-c83b-417c-b8c7-0244c26bcce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:29.665608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ceabd5c9-c83b-417c-b8c7-0244c26bcce8 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:29.666826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ceabd5c9-c83b-417c-b8c7-0244c26bcce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:29.710065 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:29.764905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:18:29 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:29.916483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740b7c2-bb1b-4831-9225-b6c4e687e06f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:29.917953 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8740b7c2-bb1b-4831-9225-b6c4e687e06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:30.064977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740b7c2-bb1b-4831-9225-b6c4e687e06f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:30.122794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:30.186004 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8984db-db66-45e3-a722-8163b85ab235 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:30.186527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8984db-db66-45e3-a722-8163b85ab235 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:30.186801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8984db-db66-45e3-a722-8163b85ab235 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:30.187068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8984db-db66-45e3-a722-8163b85ab235 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:30.188705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ef8984db-db66-45e3-a722-8163b85ab235 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:30.282960 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8984db-db66-45e3-a722-8163b85ab235 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:30.285466 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8984db-db66-45e3-a722-8163b85ab235 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:30.305273 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 722/1437] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:29 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:31.125957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65580802-8f6a-4fa8-bf26-bf3b5e76d79b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:31.126523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65580802-8f6a-4fa8-bf26-bf3b5e76d79b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:31.126523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65580802-8f6a-4fa8-bf26-bf3b5e76d79b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:31.127854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:18:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:31.133212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86236299-370e-4a0b-b5dc-74cba4d4bc86 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:31.133679 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86236299-370e-4a0b-b5dc-74cba4d4bc86 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:31.133785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86236299-370e-4a0b-b5dc-74cba4d4bc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:31.215404 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-86236299-370e-4a0b-b5dc-74cba4d4bc86 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:31.216713 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-86236299-370e-4a0b-b5dc-74cba4d4bc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:31.218883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:31.319556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:18:31 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:31.469216 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65580802-8f6a-4fa8-bf26-bf3b5e76d79b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:31.470752 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-65580802-8f6a-4fa8-bf26-bf3b5e76d79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:31.623957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65580802-8f6a-4fa8-bf26-bf3b5e76d79b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:31.651846 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:31.740721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e166ce1-069b-4cf4-9bc6-19c68c71eb39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:31.741399 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e166ce1-069b-4cf4-9bc6-19c68c71eb39 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:31.741674 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e166ce1-069b-4cf4-9bc6-19c68c71eb39 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:31.741941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e166ce1-069b-4cf4-9bc6-19c68c71eb39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:31.743568 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2e166ce1-069b-4cf4-9bc6-19c68c71eb39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:31.833309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e166ce1-069b-4cf4-9bc6-19c68c71eb39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:31.834883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e166ce1-069b-4cf4-9bc6-19c68c71eb39 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:31.853614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 717/1440] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:31 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:33.680956 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbe5ff-7d30-4a9e-8ed4-32ef00df51e8 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:33.681544 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbe5ff-7d30-4a9e-8ed4-32ef00df51e8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:33.681544 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbe5ff-7d30-4a9e-8ed4-32ef00df51e8 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:33.682845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:18:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:33.688363 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff139f-cb06-4437-bcbd-4b5f1ae484dd None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:33.688798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff139f-cb06-4437-bcbd-4b5f1ae484dd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:33.688943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff139f-cb06-4437-bcbd-4b5f1ae484dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:33.732655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:33.759010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-23ff139f-cb06-4437-bcbd-4b5f1ae484dd None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:33.760234 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-23ff139f-cb06-4437-bcbd-4b5f1ae484dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:33.856554 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:18:33 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:34.145885 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbe5ff-7d30-4a9e-8ed4-32ef00df51e8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:34.147438 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-74fbe5ff-7d30-4a9e-8ed4-32ef00df51e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:34.255549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbe5ff-7d30-4a9e-8ed4-32ef00df51e8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:34.287031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:34.330532 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd3939-e0fb-4189-95e1-02275c0c0949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:34.331796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd3939-e0fb-4189-95e1-02275c0c0949 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:34.332073 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd3939-e0fb-4189-95e1-02275c0c0949 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:34.332343 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd3939-e0fb-4189-95e1-02275c0c0949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:34.333994 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-abcd3939-e0fb-4189-95e1-02275c0c0949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:34.442225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd3939-e0fb-4189-95e1-02275c0c0949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:34.443721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd3939-e0fb-4189-95e1-02275c0c0949 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:34.463085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 725/1443] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:34 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:36.545931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce67c8-267a-46f7-a34d-5ac435ff0bfb None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:36.546470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce67c8-267a-46f7-a34d-5ac435ff0bfb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:36.546470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce67c8-267a-46f7-a34d-5ac435ff0bfb None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:36.547807 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:18:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:36.554100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c335a4-6e08-40e9-b172-106432b39b02 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:36.554570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c335a4-6e08-40e9-b172-106432b39b02 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:36.554669 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c335a4-6e08-40e9-b172-106432b39b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:36.621023 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d4c335a4-6e08-40e9-b172-106432b39b02 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:36.622222 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d4c335a4-6e08-40e9-b172-106432b39b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:36.639377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:36.731417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:18:36 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:37.017436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce67c8-267a-46f7-a34d-5ac435ff0bfb None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:37.019003 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e2ce67c8-267a-46f7-a34d-5ac435ff0bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:37.122731 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce67c8-267a-46f7-a34d-5ac435ff0bfb None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:37.140267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:37.198660 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a4721-5ce0-4916-bf11-b807eec8d6ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:37.199260 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a4721-5ce0-4916-bf11-b807eec8d6ee service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:37.199534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a4721-5ce0-4916-bf11-b807eec8d6ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:37.199802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a4721-5ce0-4916-bf11-b807eec8d6ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:37.201439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f66a4721-5ce0-4916-bf11-b807eec8d6ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:37.313446 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a4721-5ce0-4916-bf11-b807eec8d6ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:37.315239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a4721-5ce0-4916-bf11-b807eec8d6ee service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:37.334272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 720/1446] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:37 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:39.826016 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0684ea-440c-47f7-8866-a3e6cfeed771 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:39.826583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0684ea-440c-47f7-8866-a3e6cfeed771 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:39.826583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0684ea-440c-47f7-8866-a3e6cfeed771 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:39.827923 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:18:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:39.833998 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60490f-3b19-4520-ae7b-94db7de319cd None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:39.834454 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60490f-3b19-4520-ae7b-94db7de319cd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:39.834595 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60490f-3b19-4520-ae7b-94db7de319cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:39.884271 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:39.903401 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6d60490f-3b19-4520-ae7b-94db7de319cd None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:39.904906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6d60490f-3b19-4520-ae7b-94db7de319cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:40.004776 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:18:39 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:40.288384 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0684ea-440c-47f7-8866-a3e6cfeed771 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:40.289993 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3f0684ea-440c-47f7-8866-a3e6cfeed771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:40.399319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0684ea-440c-47f7-8866-a3e6cfeed771 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:40.439880 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:40.474960 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693c5c2-dee8-472b-a5db-72398e6a4bcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:40.475563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693c5c2-dee8-472b-a5db-72398e6a4bcb service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:40.475836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693c5c2-dee8-472b-a5db-72398e6a4bcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:40.476103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693c5c2-dee8-472b-a5db-72398e6a4bcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:40.477739 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e693c5c2-dee8-472b-a5db-72398e6a4bcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:40.587839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693c5c2-dee8-472b-a5db-72398e6a4bcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:40.589322 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693c5c2-dee8-472b-a5db-72398e6a4bcb service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:40.609780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 728/1449] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:40 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:18:42.812383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900195f3-34ec-4388-9184-ba35019536e6 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:42.812979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900195f3-34ec-4388-9184-ba35019536e6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:42.812979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900195f3-34ec-4388-9184-ba35019536e6 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:42.814345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:18:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:42.819756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebe358-aa10-4676-9def-dd691662c02c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:42.820188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebe358-aa10-4676-9def-dd691662c02c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:42.820305 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebe358-aa10-4676-9def-dd691662c02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:42.887774 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-abebe358-aa10-4676-9def-dd691662c02c None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:42.889015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-abebe358-aa10-4676-9def-dd691662c02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:42.910063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:42.991818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:18:42 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:43.275278 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900195f3-34ec-4388-9184-ba35019536e6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:43.276862 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-900195f3-34ec-4388-9184-ba35019536e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:43.386449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900195f3-34ec-4388-9184-ba35019536e6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:43.407015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:43.462323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e27ef-8862-4b26-a788-119f07ddbc76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:43.462930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e27ef-8862-4b26-a788-119f07ddbc76 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:43.463211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e27ef-8862-4b26-a788-119f07ddbc76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:43.463485 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e27ef-8862-4b26-a788-119f07ddbc76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:43.465148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e68e27ef-8862-4b26-a788-119f07ddbc76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:43.573446 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e27ef-8862-4b26-a788-119f07ddbc76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:43.574792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e27ef-8862-4b26-a788-119f07ddbc76 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:43.593149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 723/1452] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:43 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:45.594990 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba69444-918c-40c1-90ef-0c0798c2af0e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:45.595528 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba69444-918c-40c1-90ef-0c0798c2af0e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:45.595528 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba69444-918c-40c1-90ef-0c0798c2af0e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:45.597529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:18:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:45.603013 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae03fb8-f7d9-4bfa-bbb4-2282710a4678 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:45.603474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae03fb8-f7d9-4bfa-bbb4-2282710a4678 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:45.603580 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae03fb8-f7d9-4bfa-bbb4-2282710a4678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:45.668207 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:45.670958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6ae03fb8-f7d9-4bfa-bbb4-2282710a4678 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:45.672853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6ae03fb8-f7d9-4bfa-bbb4-2282710a4678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:45.772693 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:18:45 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:46.059376 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba69444-918c-40c1-90ef-0c0798c2af0e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:46.060981 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9ba69444-918c-40c1-90ef-0c0798c2af0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:46.284948 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba69444-918c-40c1-90ef-0c0798c2af0e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:46.344718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:46.371744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13367c7-8405-49ac-ac55-d63cd17a4e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:46.372354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13367c7-8405-49ac-ac55-d63cd17a4e00 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:46.372652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13367c7-8405-49ac-ac55-d63cd17a4e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:46.372926 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13367c7-8405-49ac-ac55-d63cd17a4e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:46.374526 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d13367c7-8405-49ac-ac55-d63cd17a4e00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:46.482180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13367c7-8405-49ac-ac55-d63cd17a4e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:46.483613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13367c7-8405-49ac-ac55-d63cd17a4e00 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:46.501937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 731/1455] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:46 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:48.481259 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8c752-48aa-466c-a3de-08794728dbc2 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:48.481746 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8c752-48aa-466c-a3de-08794728dbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:48.481869 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8c752-48aa-466c-a3de-08794728dbc2 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:48.483126 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:18:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:48.489190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bef8a-a2f0-4455-afbb-f1f504a156d7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:48.489645 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bef8a-a2f0-4455-afbb-f1f504a156d7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:48.489744 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bef8a-a2f0-4455-afbb-f1f504a156d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:48.555846 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4e4bef8a-a2f0-4455-afbb-f1f504a156d7 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:48.557091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4e4bef8a-a2f0-4455-afbb-f1f504a156d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:48.586649 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:48.655010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:18:48 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:48.958255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8c752-48aa-466c-a3de-08794728dbc2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:48.959803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-68a8c752-48aa-466c-a3de-08794728dbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:49.066509 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8c752-48aa-466c-a3de-08794728dbc2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:49.095370 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:49.141360 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb69e25-1fc4-4162-9331-ef79c698da51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:49.141970 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb69e25-1fc4-4162-9331-ef79c698da51 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:49.142249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb69e25-1fc4-4162-9331-ef79c698da51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:49.142519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb69e25-1fc4-4162-9331-ef79c698da51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:49.144404 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8fb69e25-1fc4-4162-9331-ef79c698da51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:49.253314 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb69e25-1fc4-4162-9331-ef79c698da51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:49.254657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb69e25-1fc4-4162-9331-ef79c698da51 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:49.273159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 726/1458] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:48 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:51.282071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bb647-9af4-4692-95d9-929d78f6d8ae None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:51.282610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bb647-9af4-4692-95d9-929d78f6d8ae None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:51.282610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bb647-9af4-4692-95d9-929d78f6d8ae None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:51.284060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:18:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:51.289708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd551766-8911-49a1-be93-019ee543dcde None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:51.290914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd551766-8911-49a1-be93-019ee543dcde None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:51.290914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd551766-8911-49a1-be93-019ee543dcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:51.357243 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-cd551766-8911-49a1-be93-019ee543dcde None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:51.358522 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cd551766-8911-49a1-be93-019ee543dcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:51.367509 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:51.458604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:18:51 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:51.742132 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bb647-9af4-4692-95d9-929d78f6d8ae None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:51.743670 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-340bb647-9af4-4692-95d9-929d78f6d8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:51.848206 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bb647-9af4-4692-95d9-929d78f6d8ae None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:51.902244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:51.921287 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e7ed5-549c-4ebd-9572-1a338774213a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:51.922021 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e7ed5-549c-4ebd-9572-1a338774213a service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:51.922295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e7ed5-549c-4ebd-9572-1a338774213a service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:51.922556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e7ed5-549c-4ebd-9572-1a338774213a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:51.925382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-120e7ed5-549c-4ebd-9572-1a338774213a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:52.034704 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e7ed5-549c-4ebd-9572-1a338774213a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:52.036165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e7ed5-549c-4ebd-9572-1a338774213a service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:52.054979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 734/1461] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:51 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:54.024103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e76fd-b1f8-4284-9a51-c71cca471821 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:54.024641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e76fd-b1f8-4284-9a51-c71cca471821 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:54.024764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e76fd-b1f8-4284-9a51-c71cca471821 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:54.026010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:18:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:54.031762 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15c527-3fa5-432c-9d15-28f0bb563cff None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:54.032216 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15c527-3fa5-432c-9d15-28f0bb563cff None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:54.032312 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15c527-3fa5-432c-9d15-28f0bb563cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:54.100164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7b15c527-3fa5-432c-9d15-28f0bb563cff None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:54.101417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7b15c527-3fa5-432c-9d15-28f0bb563cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:54.140383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:54.198300 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:18:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:54.487833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e76fd-b1f8-4284-9a51-c71cca471821 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:54.489449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-502e76fd-b1f8-4284-9a51-c71cca471821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:54.593363 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e76fd-b1f8-4284-9a51-c71cca471821 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:54.632071 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:54.669345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a9661-12a0-4ae9-ba65-1420e23d0b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:54.669946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a9661-12a0-4ae9-ba65-1420e23d0b9e service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:54.670224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a9661-12a0-4ae9-ba65-1420e23d0b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:54.670494 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a9661-12a0-4ae9-ba65-1420e23d0b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:54.672114 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fe2a9661-12a0-4ae9-ba65-1420e23d0b9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:54.781607 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a9661-12a0-4ae9-ba65-1420e23d0b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:54.783069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a9661-12a0-4ae9-ba65-1420e23d0b9e service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:54.801284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 729/1464] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:54 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:56.769566 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595a9d0-6068-4c01-9c8b-ff332feebd87 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:56.770109 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595a9d0-6068-4c01-9c8b-ff332feebd87 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:56.770109 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595a9d0-6068-4c01-9c8b-ff332feebd87 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:56.771459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:18:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:56.776850 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dde6b-bec0-414b-bbc5-ae9e9bd4ecce None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:56.777306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dde6b-bec0-414b-bbc5-ae9e9bd4ecce None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:56.777431 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dde6b-bec0-414b-bbc5-ae9e9bd4ecce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:56.844016 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3a7dde6b-bec0-414b-bbc5-ae9e9bd4ecce None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:56.845948 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3a7dde6b-bec0-414b-bbc5-ae9e9bd4ecce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:56.863867 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:56.952801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:18:56 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:57.245460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595a9d0-6068-4c01-9c8b-ff332feebd87 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:57.247034 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9595a9d0-6068-4c01-9c8b-ff332feebd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:57.352387 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595a9d0-6068-4c01-9c8b-ff332feebd87 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:57.420756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:57.429306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183a59a-cd55-4b2e-a174-189bac5cd202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:57.429908 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183a59a-cd55-4b2e-a174-189bac5cd202 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:57.430183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183a59a-cd55-4b2e-a174-189bac5cd202 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:57.430452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183a59a-cd55-4b2e-a174-189bac5cd202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:57.432043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7183a59a-cd55-4b2e-a174-189bac5cd202 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:57.543931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183a59a-cd55-4b2e-a174-189bac5cd202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:57.545440 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183a59a-cd55-4b2e-a174-189bac5cd202 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:57.563763 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 737/1467] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:57 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:59.514026 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ade00-516e-4ff3-ab44-e9f684a70905 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:59.514605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ade00-516e-4ff3-ab44-e9f684a70905 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:59.514605 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ade00-516e-4ff3-ab44-e9f684a70905 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:59.515959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:18:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:18:59.522242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f007f0b-fd59-44d4-b6bb-ea97c3b28d3a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:59.522682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f007f0b-fd59-44d4-b6bb-ea97c3b28d3a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:59.522788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f007f0b-fd59-44d4-b6bb-ea97c3b28d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:59.589391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0f007f0b-fd59-44d4-b6bb-ea97c3b28d3a None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:59.590607 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0f007f0b-fd59-44d4-b6bb-ea97c3b28d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:59.639788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:59.690910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:18:59 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:59.974656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ade00-516e-4ff3-ab44-e9f684a70905 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:59.976197 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d04ade00-516e-4ff3-ab44-e9f684a70905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:00.087450 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ade00-516e-4ff3-ab44-e9f684a70905 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:00.135324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:00.162583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff39500-1d14-4318-998a-8fa4cd8a226c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:00.163303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff39500-1d14-4318-998a-8fa4cd8a226c service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:00.163578 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff39500-1d14-4318-998a-8fa4cd8a226c service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:00.163846 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff39500-1d14-4318-998a-8fa4cd8a226c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:00.165468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5ff39500-1d14-4318-998a-8fa4cd8a226c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:00.275436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff39500-1d14-4318-998a-8fa4cd8a226c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:00.276817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff39500-1d14-4318-998a-8fa4cd8a226c service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:00.295558 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 732/1470] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:18:59 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:19:09.688841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=22 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:10.297801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=66 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:19.990681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f129bc8-930b-4448-9f09-c07f4ed29d3b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:19.991276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f129bc8-930b-4448-9f09-c07f4ed29d3b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:19.991276 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f129bc8-930b-4448-9f09-c07f4ed29d3b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:19.992565 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 739/1471] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:19:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:19:19.998055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718be7d-4396-4e17-b84f-6bc4049f9841 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:19.998435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718be7d-4396-4e17-b84f-6bc4049f9841 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:19.998600 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718be7d-4396-4e17-b84f-6bc4049f9841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:20.075197 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6718be7d-4396-4e17-b84f-6bc4049f9841 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:20.076436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6718be7d-4396-4e17-b84f-6bc4049f9841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:20.181403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 733/1472] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:19:19 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:19:20.488860 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2140bb-e200-49d1-a8bb-302c33bd8c3d None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:20.489169 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2140bb-e200-49d1-a8bb-302c33bd8c3d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:20.489441 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2140bb-e200-49d1-a8bb-302c33bd8c3d None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:20.490775 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 740/1473] 10.222.0.107 () {54 vars in 972 bytes} [Tue Aug 23 23:19:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:19:20.495858 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda563f-e18a-44eb-a239-3ba62db5bd0b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:20.496146 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda563f-e18a-44eb-a239-3ba62db5bd0b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:20.496497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda563f-e18a-44eb-a239-3ba62db5bd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:20.583922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0eda563f-e18a-44eb-a239-3ba62db5bd0b None None] MFA Rules not processed for user `a43ac193836248959a0380a76549ec10`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:20.585170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0eda563f-e18a-44eb-a239-3ba62db5bd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:20.616078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:20.675228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 734/1474] 10.222.0.107 () {58 vars in 1069 bytes} [Tue Aug 23 23:19:20 2022] POST /identity/v3/auth/tokens => generated 3130 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:19:20.683377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2140bb-e200-49d1-a8bb-302c33bd8c3d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:20.685215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fe2140bb-e200-49d1-a8bb-302c33bd8c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:20.795113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2140bb-e200-49d1-a8bb-302c33bd8c3d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:20.869721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40294c26-e9b0-4fa4-9b73-db0ad9fa1e3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43ac193836248959a0380a76549ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:20.870325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40294c26-e9b0-4fa4-9b73-db0ad9fa1e3a service glance] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:20.870603 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40294c26-e9b0-4fa4-9b73-db0ad9fa1e3a service glance] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:20.870870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40294c26-e9b0-4fa4-9b73-db0ad9fa1e3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:20.872489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-40294c26-e9b0-4fa4-9b73-db0ad9fa1e3a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:20.927959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:20.987255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40294c26-e9b0-4fa4-9b73-db0ad9fa1e3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:20.988716 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40294c26-e9b0-4fa4-9b73-db0ad9fa1e3a service glance] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:21.007809 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 741/1475] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:19:20 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:19:23.037886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79864fb6-13bd-4daf-bc98-3c7efefb71a5 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:23.038454 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79864fb6-13bd-4daf-bc98-3c7efefb71a5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:23.038454 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79864fb6-13bd-4daf-bc98-3c7efefb71a5 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:23.039756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 735/1476] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:19:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:19:23.045344 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0ca64-c10d-4711-9435-d65721fd928b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:23.045826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0ca64-c10d-4711-9435-d65721fd928b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:23.045941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0ca64-c10d-4711-9435-d65721fd928b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:23.119363 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-acf0ca64-c10d-4711-9435-d65721fd928b None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:23.120611 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-acf0ca64-c10d-4711-9435-d65721fd928b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:23.227680 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 742/1477] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:19:23 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:19:23.503043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79864fb6-13bd-4daf-bc98-3c7efefb71a5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:23.504798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-79864fb6-13bd-4daf-bc98-3c7efefb71a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:23.630955 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79864fb6-13bd-4daf-bc98-3c7efefb71a5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:23.681661 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:23.727228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0c01d-7d2c-4246-90ef-bcee9b8dc0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:23.727830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0c01d-7d2c-4246-90ef-bcee9b8dc0af admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:23.728106 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0c01d-7d2c-4246-90ef-bcee9b8dc0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:23.728375 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0c01d-7d2c-4246-90ef-bcee9b8dc0af admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:23.729044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0c01d-7d2c-4246-90ef-bcee9b8dc0af admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:23.730819 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: WARNING py.warnings [None req-7cb0c01d-7d2c-4246-90ef-bcee9b8dc0af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:19:23.730819 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: warnings.warn(msg) Aug 23 23:19:23.730819 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: Aug 23 23:19:23.731983 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0c01d-7d2c-4246-90ef-bcee9b8dc0af admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:23.753383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 736/1478] 10.222.0.107 () {56 vars in 1113 bytes} [Tue Aug 23 23:19:23 2022] GET /identity/v3/projects => generated 2562 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:19:25.704549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f4166-0f2b-45b3-bacc-3faa9d6b1bf5 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:25.705117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f4166-0f2b-45b3-bacc-3faa9d6b1bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:25.705117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f4166-0f2b-45b3-bacc-3faa9d6b1bf5 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:25.706681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 743/1479] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:19:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:19:25.712270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278d1a3-182a-4b1e-bd31-9ea2cd2e6eff None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:25.712813 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278d1a3-182a-4b1e-bd31-9ea2cd2e6eff None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:25.712927 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278d1a3-182a-4b1e-bd31-9ea2cd2e6eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:25.779635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3278d1a3-182a-4b1e-bd31-9ea2cd2e6eff None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:25.781310 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3278d1a3-182a-4b1e-bd31-9ea2cd2e6eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:25.878449 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 737/1480] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:19:25 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:19:26.176448 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f4166-0f2b-45b3-bacc-3faa9d6b1bf5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:26.178264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b70f4166-0f2b-45b3-bacc-3faa9d6b1bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:26.188729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:26.326598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f4166-0f2b-45b3-bacc-3faa9d6b1bf5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:26.411943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:26.445913 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b869a4-11b6-42c4-ad54-d5fa411493fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:26.446516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b869a4-11b6-42c4-ad54-d5fa411493fa service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:26.446790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b869a4-11b6-42c4-ad54-d5fa411493fa service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:26.447057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b869a4-11b6-42c4-ad54-d5fa411493fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:26.448696 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d4b869a4-11b6-42c4-ad54-d5fa411493fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:26.538766 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b869a4-11b6-42c4-ad54-d5fa411493fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:26.540358 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b869a4-11b6-42c4-ad54-d5fa411493fa service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:26.559711 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 744/1481] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:19:26 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:19:28.699510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d8314-ae28-434c-8a87-383d96aa01c1 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:28.700112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d8314-ae28-434c-8a87-383d96aa01c1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:28.700226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d8314-ae28-434c-8a87-383d96aa01c1 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:28.701788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 738/1482] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:19:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:19:28.707651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dbe1f-5c43-4435-8f52-9514e398ce93 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:28.708163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dbe1f-5c43-4435-8f52-9514e398ce93 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:28.708285 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dbe1f-5c43-4435-8f52-9514e398ce93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:28.800154 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-275dbe1f-5c43-4435-8f52-9514e398ce93 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:28.801978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-275dbe1f-5c43-4435-8f52-9514e398ce93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:28.861107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:28.913326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 745/1483] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:19:28 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:19:29.198338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d8314-ae28-434c-8a87-383d96aa01c1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:29.199961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d23d8314-ae28-434c-8a87-383d96aa01c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:29.224704 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:29.324018 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d8314-ae28-434c-8a87-383d96aa01c1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:29.402111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fa0cb-f8a3-42e8-84d9-2dc4c729bbd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:29.402962 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fa0cb-f8a3-42e8-84d9-2dc4c729bbd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:29.403248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fa0cb-f8a3-42e8-84d9-2dc4c729bbd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:29.403527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fa0cb-f8a3-42e8-84d9-2dc4c729bbd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:29.405839 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2b3fa0cb-f8a3-42e8-84d9-2dc4c729bbd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:29.607843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:29.647689 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fa0cb-f8a3-42e8-84d9-2dc4c729bbd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:29.649193 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fa0cb-f8a3-42e8-84d9-2dc4c729bbd6 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:29.668929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 739/1484] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:19:29 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:19:31.650267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b56f01-af53-4706-9e5b-593543f8f34d None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:31.650854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b56f01-af53-4706-9e5b-593543f8f34d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:31.650854 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b56f01-af53-4706-9e5b-593543f8f34d None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:31.652164 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 746/1485] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:19:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:19:31.657819 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c50d0-18d9-4075-951c-3bcc420d92f5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:31.658334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c50d0-18d9-4075-951c-3bcc420d92f5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:31.658436 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c50d0-18d9-4075-951c-3bcc420d92f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:31.727497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-579c50d0-18d9-4075-951c-3bcc420d92f5 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:31.728774 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-579c50d0-18d9-4075-951c-3bcc420d92f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:31.827242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 740/1486] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:19:31 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:19:32.115905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b56f01-af53-4706-9e5b-593543f8f34d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:32.117506 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e3b56f01-af53-4706-9e5b-593543f8f34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:32.223831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b56f01-af53-4706-9e5b-593543f8f34d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:32.298142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:32.300145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb7997-2645-43e3-b189-8caf3c19c7bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:32.301089 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb7997-2645-43e3-b189-8caf3c19c7bc service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:32.301849 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb7997-2645-43e3-b189-8caf3c19c7bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:32.301849 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb7997-2645-43e3-b189-8caf3c19c7bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:32.303525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0adb7997-2645-43e3-b189-8caf3c19c7bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:32.412807 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb7997-2645-43e3-b189-8caf3c19c7bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:32.414005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb7997-2645-43e3-b189-8caf3c19c7bc service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:32.434238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 747/1487] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:19:32 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:19:34.454311 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a322f85-8243-4d7c-a22b-173ebc2f7cf9 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:34.454886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a322f85-8243-4d7c-a22b-173ebc2f7cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:34.454886 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a322f85-8243-4d7c-a22b-173ebc2f7cf9 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:34.456228 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 741/1488] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:19:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:19:34.461776 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ce18-d6cc-4649-af40-18411a3e7f82 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:34.462229 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ce18-d6cc-4649-af40-18411a3e7f82 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:34.462338 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ce18-d6cc-4649-af40-18411a3e7f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:34.530334 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2757ce18-d6cc-4649-af40-18411a3e7f82 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:34.531575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2757ce18-d6cc-4649-af40-18411a3e7f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:34.583466 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:34.633632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 748/1489] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:19:34 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:19:34.927202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a322f85-8243-4d7c-a22b-173ebc2f7cf9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:34.928837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8a322f85-8243-4d7c-a22b-173ebc2f7cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:34.966270 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:35.044362 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a322f85-8243-4d7c-a22b-173ebc2f7cf9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:35.122209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534fb4a-d67c-4ba4-bc54-3680824e1e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:35.122815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534fb4a-d67c-4ba4-bc54-3680824e1e02 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:35.123091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534fb4a-d67c-4ba4-bc54-3680824e1e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:35.124027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534fb4a-d67c-4ba4-bc54-3680824e1e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:35.125690 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3534fb4a-d67c-4ba4-bc54-3680824e1e02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:35.209469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:35.240223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534fb4a-d67c-4ba4-bc54-3680824e1e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:35.241705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534fb4a-d67c-4ba4-bc54-3680824e1e02 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:35.262654 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 742/1490] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:19:34 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:19:37.528217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f799445-0410-46cb-9280-2a5128e67430 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:37.528785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f799445-0410-46cb-9280-2a5128e67430 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:37.528785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f799445-0410-46cb-9280-2a5128e67430 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:37.530451 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 749/1491] 10.222.0.107 () {54 vars in 932 bytes} [Tue Aug 23 23:19:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:19:37.536069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b2aa0-0d02-4756-a7f7-55d15ab7eea3 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:37.536531 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b2aa0-0d02-4756-a7f7-55d15ab7eea3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:37.536650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b2aa0-0d02-4756-a7f7-55d15ab7eea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:37.601490 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-608b2aa0-0d02-4756-a7f7-55d15ab7eea3 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:19:37.602700 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-608b2aa0-0d02-4756-a7f7-55d15ab7eea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:37.699388 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 743/1492] 10.222.0.107 () {58 vars in 1029 bytes} [Tue Aug 23 23:19:37 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:19:37.990381 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f799445-0410-46cb-9280-2a5128e67430 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:19:37.992020 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0f799445-0410-46cb-9280-2a5128e67430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:38.100161 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f799445-0410-46cb-9280-2a5128e67430 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:19:38.177250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b10ff-e443-46e1-ad1c-c09f2f22233a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:19:38.177856 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b10ff-e443-46e1-ad1c-c09f2f22233a service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:19:38.178129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b10ff-e443-46e1-ad1c-c09f2f22233a service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:19:38.178403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b10ff-e443-46e1-ad1c-c09f2f22233a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:19:38.180229 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6e0b10ff-e443-46e1-ad1c-c09f2f22233a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:19:38.190085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:38.293541 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b10ff-e443-46e1-ad1c-c09f2f22233a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:19:38.295748 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b10ff-e443-46e1-ad1c-c09f2f22233a service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:19:38.313996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 750/1493] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:19:37 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:19:47.697507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=82 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:48.311684 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=50 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:50.925729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097762c-238b-47f9-8100-af5109ed52cd None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:50.926331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097762c-238b-47f9-8100-af5109ed52cd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:50.926331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097762c-238b-47f9-8100-af5109ed52cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:51.004336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a097762c-238b-47f9-8100-af5109ed52cd None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:51.005596 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a097762c-238b-47f9-8100-af5109ed52cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:51.102179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 744/1494] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:20:50 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:20:51.111043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8165040-13b1-4277-990c-48a1232e3cb0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:51.111544 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8165040-13b1-4277-990c-48a1232e3cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:51.111658 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8165040-13b1-4277-990c-48a1232e3cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:51.189201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d8165040-13b1-4277-990c-48a1232e3cb0 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:51.190339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d8165040-13b1-4277-990c-48a1232e3cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:51.288732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 751/1495] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:20:51 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:20:51.294465 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097762c-238b-47f9-8100-af5109ed52cd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:51.295667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a097762c-238b-47f9-8100-af5109ed52cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:51.307145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097762c-238b-47f9-8100-af5109ed52cd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:51.371821 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:51.406571 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff216ff-c4f8-4c7e-9e50-42f7a54c6336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:51.407382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff216ff-c4f8-4c7e-9e50-42f7a54c6336 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:51.407691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff216ff-c4f8-4c7e-9e50-42f7a54c6336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:51.407985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff216ff-c4f8-4c7e-9e50-42f7a54c6336 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:51.408647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff216ff-c4f8-4c7e-9e50-42f7a54c6336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:51.408948 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff216ff-c4f8-4c7e-9e50-42f7a54c6336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:51.409979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: WARNING py.warnings [None req-8ff216ff-c4f8-4c7e-9e50-42f7a54c6336 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:20:51.409979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: warnings.warn(msg) Aug 23 23:20:51.409979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: Aug 23 23:20:51.410860 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff216ff-c4f8-4c7e-9e50-42f7a54c6336 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:51.422861 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 745/1496] 10.222.0.107 () {58 vars in 1158 bytes} [Tue Aug 23 23:20:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:20:51.431304 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8165040-13b1-4277-990c-48a1232e3cb0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:51.440313 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8165040-13b1-4277-990c-48a1232e3cb0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:51.501058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:51.540008 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2524852-0cbd-4e4b-b0cb-104218605dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:51.540633 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2524852-0cbd-4e4b-b0cb-104218605dae admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:51.540915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2524852-0cbd-4e4b-b0cb-104218605dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:51.541188 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2524852-0cbd-4e4b-b0cb-104218605dae admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:51.541803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2524852-0cbd-4e4b-b0cb-104218605dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:51.543572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: WARNING py.warnings [None req-a2524852-0cbd-4e4b-b0cb-104218605dae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:20:51.543572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: warnings.warn(msg) Aug 23 23:20:51.543572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: Aug 23 23:20:51.545094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2524852-0cbd-4e4b-b0cb-104218605dae admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:51.601091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 752/1497] 10.222.0.107 () {60 vars in 1158 bytes} [Tue Aug 23 23:20:51 2022] POST /identity/v3/projects => generated 378 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:20:51.605764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff216ff-c4f8-4c7e-9e50-42f7a54c6336 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:51.607354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8ff216ff-c4f8-4c7e-9e50-42f7a54c6336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:51.642327 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff216ff-c4f8-4c7e-9e50-42f7a54c6336 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:51.737326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eafef7-3374-41cd-819e-589dc1d86646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:51.737948 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eafef7-3374-41cd-819e-589dc1d86646 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:51.738221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eafef7-3374-41cd-819e-589dc1d86646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:51.738517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eafef7-3374-41cd-819e-589dc1d86646 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:51.739140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eafef7-3374-41cd-819e-589dc1d86646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:51.740133 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: WARNING py.warnings [None req-e6eafef7-3374-41cd-819e-589dc1d86646 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:20:51.740133 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: warnings.warn(msg) Aug 23 23:20:51.740133 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: Aug 23 23:20:51.741430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eafef7-3374-41cd-819e-589dc1d86646 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:51.783284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 746/1498] 10.222.0.107 () {60 vars in 1149 bytes} [Tue Aug 23 23:20:51 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:20:51.787329 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2524852-0cbd-4e4b-b0cb-104218605dae admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:51.788907 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a2524852-0cbd-4e4b-b0cb-104218605dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:51.851008 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2524852-0cbd-4e4b-b0cb-104218605dae admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:51.934893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:51.946275 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b841ef9-32f1-4b31-83d5-d998a940082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:51.946883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b841ef9-32f1-4b31-83d5-d998a940082d admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:51.947158 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b841ef9-32f1-4b31-83d5-d998a940082d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:51.947463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b841ef9-32f1-4b31-83d5-d998a940082d admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:51.948204 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b841ef9-32f1-4b31-83d5-d998a940082d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:51.949256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: WARNING py.warnings [None req-8b841ef9-32f1-4b31-83d5-d998a940082d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:20:51.949256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: warnings.warn(msg) Aug 23 23:20:51.949256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: Aug 23 23:20:51.950145 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b841ef9-32f1-4b31-83d5-d998a940082d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:51.962523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 753/1499] 10.222.0.107 () {58 vars in 1127 bytes} [Tue Aug 23 23:20:51 2022] GET /identity/v3/roles => generated 1427 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:20:51.967216 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eafef7-3374-41cd-819e-589dc1d86646 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:51.968786 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e6eafef7-3374-41cd-819e-589dc1d86646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:51.980924 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eafef7-3374-41cd-819e-589dc1d86646 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:52.005620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:52.080895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033226a-0f12-43d8-8d2b-24a8119003fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:52.081494 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033226a-0f12-43d8-8d2b-24a8119003fc admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:52.081797 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033226a-0f12-43d8-8d2b-24a8119003fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:52.082061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033226a-0f12-43d8-8d2b-24a8119003fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:52.082695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033226a-0f12-43d8-8d2b-24a8119003fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:52.083706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: WARNING py.warnings [None req-c033226a-0f12-43d8-8d2b-24a8119003fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:20:52.083706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: warnings.warn(msg) Aug 23 23:20:52.083706 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: Aug 23 23:20:52.084628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033226a-0f12-43d8-8d2b-24a8119003fc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:52.097416 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 747/1500] 10.222.0.107 () {58 vars in 1127 bytes} [Tue Aug 23 23:20:51 2022] GET /identity/v3/roles => generated 1427 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:20:52.101614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b841ef9-32f1-4b31-83d5-d998a940082d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:52.103140 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8b841ef9-32f1-4b31-83d5-d998a940082d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:52.136061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b841ef9-32f1-4b31-83d5-d998a940082d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:52.232529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5171f27-a02e-453e-9c55-ad38b57c1a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:52.233214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5171f27-a02e-453e-9c55-ad38b57c1a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:52.233489 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5171f27-a02e-453e-9c55-ad38b57c1a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:52.233758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5171f27-a02e-453e-9c55-ad38b57c1a20 admin admin] PATH_INFO: `/v3/projects/07ea666ac2754fc696e96750beb224c3/users/9240173f5bde403fae26261bd9752b15/roles/6be1975947cd4b948b86c73132244927` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:52.266284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5171f27-a02e-453e-9c55-ad38b57c1a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ea666ac2754fc696e96750beb224c3, user_id=9240173f5bde403fae26261bd9752b15, role_id=6be1975947cd4b948b86c73132244927)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:52.267234 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: WARNING py.warnings [None req-a5171f27-a02e-453e-9c55-ad38b57c1a20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:20:52.267234 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: warnings.warn(msg) Aug 23 23:20:52.267234 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: Aug 23 23:20:52.269248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5171f27-a02e-453e-9c55-ad38b57c1a20 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:52.295135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 754/1501] 10.222.0.107 () {60 vars in 1488 bytes} [Tue Aug 23 23:20:52 2022] PUT /identity/v3/projects/07ea666ac2754fc696e96750beb224c3/users/9240173f5bde403fae26261bd9752b15/roles/6be1975947cd4b948b86c73132244927 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:20:52.307419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efac8f-0a47-44c0-89b7-daa42611400b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:52.307703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efac8f-0a47-44c0-89b7-daa42611400b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:52.307978 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efac8f-0a47-44c0-89b7-daa42611400b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:52.370149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-30efac8f-0a47-44c0-89b7-daa42611400b None None] MFA Rules not processed for user `9240173f5bde403fae26261bd9752b15`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:52.371368 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-30efac8f-0a47-44c0-89b7-daa42611400b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:52.449500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 748/1502] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:20:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:20:52.462701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63504e44-497e-47b1-aebc-5ca5bcd20a21 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:52.462986 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63504e44-497e-47b1-aebc-5ca5bcd20a21 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:52.463265 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63504e44-497e-47b1-aebc-5ca5bcd20a21 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:52.464632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 755/1503] 10.222.0.107 () {54 vars in 969 bytes} [Tue Aug 23 23:20:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:20:52.469549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b71b08-37e5-42a4-8472-5a55b75dcb5a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:52.469838 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b71b08-37e5-42a4-8472-5a55b75dcb5a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:52.470144 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b71b08-37e5-42a4-8472-5a55b75dcb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:52.501266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:52.547469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-00b71b08-37e5-42a4-8472-5a55b75dcb5a None None] MFA Rules not processed for user `8937ae9f5c7840a2a5af5f851d02ea77`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:52.548618 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-00b71b08-37e5-42a4-8472-5a55b75dcb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:52.625324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 749/1504] 10.222.0.107 () {58 vars in 1066 bytes} [Tue Aug 23 23:20:52 2022] POST /identity/v3/auth/tokens => generated 3130 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:20:52.633221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63504e44-497e-47b1-aebc-5ca5bcd20a21 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:52.635418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-63504e44-497e-47b1-aebc-5ca5bcd20a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:52.687865 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:52.743174 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63504e44-497e-47b1-aebc-5ca5bcd20a21 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:52.817556 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870fd21-9012-46b2-a117-6eea9e5549a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8937ae9f5c7840a2a5af5f851d02ea77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:52.818079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870fd21-9012-46b2-a117-6eea9e5549a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:52.818355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870fd21-9012-46b2-a117-6eea9e5549a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:52.818625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870fd21-9012-46b2-a117-6eea9e5549a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:52.820224 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e870fd21-9012-46b2-a117-6eea9e5549a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:52.925197 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870fd21-9012-46b2-a117-6eea9e5549a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:52.926608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870fd21-9012-46b2-a117-6eea9e5549a1 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:52.930122 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:52.945769 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 756/1505] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:20:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:20:52.991682 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9c1c9-d418-4069-86e3-979ec3af8555 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:52.992141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9c1c9-d418-4069-86e3-979ec3af8555 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:52.992245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9c1c9-d418-4069-86e3-979ec3af8555 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:52.993527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 750/1506] 10.222.0.107 () {52 vars in 835 bytes} [Tue Aug 23 23:20:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:20:52.997796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870fd21-9012-46b2-a117-6eea9e5549a1 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:52.998590 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e870fd21-9012-46b2-a117-6eea9e5549a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:53.098818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870fd21-9012-46b2-a117-6eea9e5549a1 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:53.192562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470f556-68e3-44bc-a35f-f3c03d2802f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:53.193326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470f556-68e3-44bc-a35f-f3c03d2802f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:53.193499 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470f556-68e3-44bc-a35f-f3c03d2802f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:53.193770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470f556-68e3-44bc-a35f-f3c03d2802f8 admin admin] PATH_INFO: `/v3/users/9240173f5bde403fae26261bd9752b15` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:53.206126 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470f556-68e3-44bc-a35f-f3c03d2802f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9240173f5bde403fae26261bd9752b15)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:53.207142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: WARNING py.warnings [None req-d470f556-68e3-44bc-a35f-f3c03d2802f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:20:53.207142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: warnings.warn(msg) Aug 23 23:20:53.207142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: Aug 23 23:20:53.208363 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470f556-68e3-44bc-a35f-f3c03d2802f8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:53.218939 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:53.278169 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d470f556-68e3-44bc-a35f-f3c03d2802f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9240173f5bde403fae26261bd9752b15'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:20:53.295968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d470f556-68e3-44bc-a35f-f3c03d2802f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9240173f5bde403fae26261bd9752b15'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:20:53.318417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d470f556-68e3-44bc-a35f-f3c03d2802f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9240173f5bde403fae26261bd9752b15'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:20:53.328726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d470f556-68e3-44bc-a35f-f3c03d2802f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9240173f5bde403fae26261bd9752b15'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:20:53.329251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d470f556-68e3-44bc-a35f-f3c03d2802f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9240173f5bde403fae26261bd9752b15'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:20:53.334883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 757/1507] 10.222.0.107 () {58 vars in 1229 bytes} [Tue Aug 23 23:20:52 2022] DELETE /identity/v3/users/9240173f5bde403fae26261bd9752b15 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:20:53.339753 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d6f43-d752-4b9c-847f-20925c6f9f8d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:53.340050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d6f43-d752-4b9c-847f-20925c6f9f8d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:53.340309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d6f43-d752-4b9c-847f-20925c6f9f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:53.396901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-268d6f43-d752-4b9c-847f-20925c6f9f8d None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:53.398037 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-268d6f43-d752-4b9c-847f-20925c6f9f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:53.474252 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:53.488264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 751/1508] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:20:53 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:20:53.498023 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470f556-68e3-44bc-a35f-f3c03d2802f8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:53.499264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d470f556-68e3-44bc-a35f-f3c03d2802f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:53.609048 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470f556-68e3-44bc-a35f-f3c03d2802f8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:53.665121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:53.686691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0682431-1f4c-4531-81d5-1e9b98d03dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:53.687301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0682431-1f4c-4531-81d5-1e9b98d03dec service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:53.687575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0682431-1f4c-4531-81d5-1e9b98d03dec service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:53.687841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0682431-1f4c-4531-81d5-1e9b98d03dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:53.689484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d0682431-1f4c-4531-81d5-1e9b98d03dec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:53.799293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0682431-1f4c-4531-81d5-1e9b98d03dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:53.800778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0682431-1f4c-4531-81d5-1e9b98d03dec service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:53.819550 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 758/1509] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:20:53 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:20:54.175465 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d6f43-d752-4b9c-847f-20925c6f9f8d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:54.176847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-268d6f43-d752-4b9c-847f-20925c6f9f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:54.188912 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d6f43-d752-4b9c-847f-20925c6f9f8d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:54.289439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e643e-ce10-497c-9e58-4d18fff69afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:54.290063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e643e-ce10-497c-9e58-4d18fff69afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:54.290340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e643e-ce10-497c-9e58-4d18fff69afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:54.290614 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e643e-ce10-497c-9e58-4d18fff69afa admin admin] PATH_INFO: `/v3/projects/07ea666ac2754fc696e96750beb224c3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:54.302237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e643e-ce10-497c-9e58-4d18fff69afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ea666ac2754fc696e96750beb224c3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:54.303266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: WARNING py.warnings [None req-058e643e-ce10-497c-9e58-4d18fff69afa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:20:54.303266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: warnings.warn(msg) Aug 23 23:20:54.303266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: Aug 23 23:20:54.304473 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e643e-ce10-497c-9e58-4d18fff69afa admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:54.363308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-058e643e-ce10-497c-9e58-4d18fff69afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ea666ac2754fc696e96750beb224c3', 'request_id': 'req-058e643e-ce10-497c-9e58-4d18fff69afa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:20:54.373226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-058e643e-ce10-497c-9e58-4d18fff69afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ea666ac2754fc696e96750beb224c3', 'request_id': 'req-058e643e-ce10-497c-9e58-4d18fff69afa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:20:54.386589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-058e643e-ce10-497c-9e58-4d18fff69afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ea666ac2754fc696e96750beb224c3', 'request_id': 'req-058e643e-ce10-497c-9e58-4d18fff69afa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:20:54.410325 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-058e643e-ce10-497c-9e58-4d18fff69afa admin admin] The token cache is being invalidate because project 07ea666ac2754fc696e96750beb224c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:20:54.410608 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-058e643e-ce10-497c-9e58-4d18fff69afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:20:54.411135 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-058e643e-ce10-497c-9e58-4d18fff69afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:20:54.412461 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 752/1510] 10.222.0.107 () {58 vars in 1238 bytes} [Tue Aug 23 23:20:54 2022] DELETE /identity/v3/projects/07ea666ac2754fc696e96750beb224c3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:21:03.817263 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=62 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:04.408299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:10.521317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eafd34-96fe-4971-941c-ade24b80c2e9 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:10.521914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eafd34-96fe-4971-941c-ade24b80c2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:10.521914 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eafd34-96fe-4971-941c-ade24b80c2e9 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:10.523221 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:22:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:22:10.527992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb494b0-cc6f-4125-969d-b7c9bc46496e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:10.528456 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb494b0-cc6f-4125-969d-b7c9bc46496e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:10.528561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb494b0-cc6f-4125-969d-b7c9bc46496e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:10.609770 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0fb494b0-cc6f-4125-969d-b7c9bc46496e None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:10.610989 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0fb494b0-cc6f-4125-969d-b7c9bc46496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:10.715181 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:22:10 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:10.871015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eafd34-96fe-4971-941c-ade24b80c2e9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:10.873170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f5eafd34-96fe-4971-941c-ade24b80c2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:10.994957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eafd34-96fe-4971-941c-ade24b80c2e9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:11.000419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d674a3-b5d7-40b2-be5c-09b65b91acf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:11.001070 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d674a3-b5d7-40b2-be5c-09b65b91acf9 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:11.001342 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d674a3-b5d7-40b2-be5c-09b65b91acf9 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:11.001607 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d674a3-b5d7-40b2-be5c-09b65b91acf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:11.010893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d674a3-b5d7-40b2-be5c-09b65b91acf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:11.012529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d674a3-b5d7-40b2-be5c-09b65b91acf9 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:11.021814 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 760/1513] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:22:10 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:22:11.847055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff90ac7-1cd7-414b-9412-891d4f3ace9b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:11.847623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff90ac7-1cd7-414b-9412-891d4f3ace9b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:11.847623 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff90ac7-1cd7-414b-9412-891d4f3ace9b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:11.848967 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:22:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:22:11.854371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8025f4c-9d1b-4516-9835-f3a72404ee54 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:11.854812 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8025f4c-9d1b-4516-9835-f3a72404ee54 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:11.854946 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8025f4c-9d1b-4516-9835-f3a72404ee54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:11.874061 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a8025f4c-9d1b-4516-9835-f3a72404ee54 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:11.875259 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a8025f4c-9d1b-4516-9835-f3a72404ee54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:11.883106 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:22:11 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:12.036417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff90ac7-1cd7-414b-9412-891d4f3ace9b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:12.051264 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff90ac7-1cd7-414b-9412-891d4f3ace9b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:12.056717 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fc38f-6cef-4151-ad30-999aa0211fa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:12.057306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fc38f-6cef-4151-ad30-999aa0211fa7 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:12.057584 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fc38f-6cef-4151-ad30-999aa0211fa7 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:12.057878 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fc38f-6cef-4151-ad30-999aa0211fa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:12.065902 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fc38f-6cef-4151-ad30-999aa0211fa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:12.067484 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fc38f-6cef-4151-ad30-999aa0211fa7 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:12.077337 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 755/1516] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:22:12 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:22:15.989440 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89579a83-7b6d-4a47-a61a-cfc99d0abbca None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:15.989976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89579a83-7b6d-4a47-a61a-cfc99d0abbca None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:15.989976 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89579a83-7b6d-4a47-a61a-cfc99d0abbca None None] PATH_INFO: `/v3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:15.991433 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 762/1517] 10.222.0.93 () {54 vars in 929 bytes} [Tue Aug 23 23:22:15 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:22:16.000537 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ce740-1382-48fa-8bcd-3418cc2153da None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:16.001007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ce740-1382-48fa-8bcd-3418cc2153da None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:16.001117 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ce740-1382-48fa-8bcd-3418cc2153da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:16.061383 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-094ce740-1382-48fa-8bcd-3418cc2153da None None] MFA Rules not processed for user `14ee6ffc0985405193735af49a398326`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:16.062662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-094ce740-1382-48fa-8bcd-3418cc2153da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:16.079685 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:16.133870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 756/1518] 10.222.0.93 () {58 vars in 1019 bytes} [Tue Aug 23 23:22:15 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:22:20.013497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a9143-cb8f-4d7a-a622-074c9002d82e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:20.013956 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a9143-cb8f-4d7a-a622-074c9002d82e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:20.014066 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a9143-cb8f-4d7a-a622-074c9002d82e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:20.015397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 763/1519] 10.222.0.107 () {54 vars in 966 bytes} [Tue Aug 23 23:22:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:22:20.020515 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dc4e8-b477-4090-a171-583eccdd434d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:20.020956 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dc4e8-b477-4090-a171-583eccdd434d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:20.021079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dc4e8-b477-4090-a171-583eccdd434d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:20.040217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-496dc4e8-b477-4090-a171-583eccdd434d None None] MFA Rules not processed for user `14ee6ffc0985405193735af49a398326`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:20.041433 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-496dc4e8-b477-4090-a171-583eccdd434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:20.050067 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 757/1520] 10.222.0.107 () {58 vars in 1063 bytes} [Tue Aug 23 23:22:20 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:20.058365 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a9143-cb8f-4d7a-a622-074c9002d82e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:20.072040 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a9143-cb8f-4d7a-a622-074c9002d82e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:20.077119 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cc9aa-5d38-4161-ade2-90ea9f8ea241 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ee6ffc0985405193735af49a398326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:20.077715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cc9aa-5d38-4161-ade2-90ea9f8ea241 service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:20.077993 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cc9aa-5d38-4161-ade2-90ea9f8ea241 service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:20.078288 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cc9aa-5d38-4161-ade2-90ea9f8ea241 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:20.086619 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cc9aa-5d38-4161-ade2-90ea9f8ea241 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:20.088185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cc9aa-5d38-4161-ade2-90ea9f8ea241 service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:20.097643 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 764/1521] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:22:20 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:22:23.295655 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae83e7-eb49-42f7-b343-07d9183516c3 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:23.296223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae83e7-eb49-42f7-b343-07d9183516c3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:23.296223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae83e7-eb49-42f7-b343-07d9183516c3 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:23.297520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:22:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:22:23.302299 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1607f0-e362-4370-9250-5d9f29b73a40 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:23.302728 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1607f0-e362-4370-9250-5d9f29b73a40 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:23.302836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1607f0-e362-4370-9250-5d9f29b73a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:23.322504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fb1607f0-e362-4370-9250-5d9f29b73a40 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:23.323683 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fb1607f0-e362-4370-9250-5d9f29b73a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:23.332075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:22:23 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:23.497038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae83e7-eb49-42f7-b343-07d9183516c3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:23.511954 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae83e7-eb49-42f7-b343-07d9183516c3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:23.517494 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf539c-b164-4b45-a37c-28036a79d491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:23.518081 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf539c-b164-4b45-a37c-28036a79d491 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:23.518351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf539c-b164-4b45-a37c-28036a79d491 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:23.518615 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf539c-b164-4b45-a37c-28036a79d491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:23.527632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf539c-b164-4b45-a37c-28036a79d491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:23.529237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf539c-b164-4b45-a37c-28036a79d491 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:23.538578 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 759/1524] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:22:23 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:22:24.379428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74617a9-2dae-4ec2-822b-16cff9a54d2d None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:24.379960 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74617a9-2dae-4ec2-822b-16cff9a54d2d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:24.380065 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74617a9-2dae-4ec2-822b-16cff9a54d2d None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:24.381542 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:22:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:22:24.386511 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268664d-4cac-4bb7-97ad-da9f66c34090 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:24.386973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268664d-4cac-4bb7-97ad-da9f66c34090 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:24.387084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268664d-4cac-4bb7-97ad-da9f66c34090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:24.407177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0268664d-4cac-4bb7-97ad-da9f66c34090 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:24.408390 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0268664d-4cac-4bb7-97ad-da9f66c34090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:24.417274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:22:24 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:24.567826 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74617a9-2dae-4ec2-822b-16cff9a54d2d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:24.582253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74617a9-2dae-4ec2-822b-16cff9a54d2d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:24.588963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60eb019-d238-4f04-b62d-668fe00962d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:24.589557 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60eb019-d238-4f04-b62d-668fe00962d4 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:24.589843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60eb019-d238-4f04-b62d-668fe00962d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:24.590115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60eb019-d238-4f04-b62d-668fe00962d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:24.598128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60eb019-d238-4f04-b62d-668fe00962d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:24.599704 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60eb019-d238-4f04-b62d-668fe00962d4 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:24.609803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 767/1527] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:22:24 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:22:28.478466 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80d998-c182-4339-96f2-79692dac1111 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:28.478996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80d998-c182-4339-96f2-79692dac1111 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:28.478996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80d998-c182-4339-96f2-79692dac1111 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:28.480370 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:22:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:22:28.485534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41204e64-6760-40da-ae19-d85694229aab None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:28.485967 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41204e64-6760-40da-ae19-d85694229aab None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:28.486084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41204e64-6760-40da-ae19-d85694229aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:28.505010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-41204e64-6760-40da-ae19-d85694229aab None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:28.506206 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-41204e64-6760-40da-ae19-d85694229aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:28.514544 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:22:28 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:28.808180 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80d998-c182-4339-96f2-79692dac1111 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:28.809934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dc80d998-c182-4339-96f2-79692dac1111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:28.887964 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80d998-c182-4339-96f2-79692dac1111 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:28.891525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13334145-3f2f-4a25-b70d-7d591437f62e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:28.892118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13334145-3f2f-4a25-b70d-7d591437f62e service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:28.892389 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13334145-3f2f-4a25-b70d-7d591437f62e service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:28.892704 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13334145-3f2f-4a25-b70d-7d591437f62e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:28.901427 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13334145-3f2f-4a25-b70d-7d591437f62e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:28.902843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13334145-3f2f-4a25-b70d-7d591437f62e service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:28.912022 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 762/1530] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:22:28 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:22:30.802347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916d5ae-e768-4d81-829b-b0c863fea500 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:30.802857 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916d5ae-e768-4d81-829b-b0c863fea500 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:30.802973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916d5ae-e768-4d81-829b-b0c863fea500 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:30.804250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:22:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:22:30.809847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e240bf-e01c-47db-9dbe-ccb86a52beab None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:30.810290 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e240bf-e01c-47db-9dbe-ccb86a52beab None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:30.810426 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e240bf-e01c-47db-9dbe-ccb86a52beab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:30.830900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-99e240bf-e01c-47db-9dbe-ccb86a52beab None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:30.832171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-99e240bf-e01c-47db-9dbe-ccb86a52beab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:30.840893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:22:30 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:31.130077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916d5ae-e768-4d81-829b-b0c863fea500 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:31.141431 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916d5ae-e768-4d81-829b-b0c863fea500 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:31.144897 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f989efd-1338-489a-be58-6aa499f538dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:31.145488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f989efd-1338-489a-be58-6aa499f538dc service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:31.145764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f989efd-1338-489a-be58-6aa499f538dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:31.146032 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f989efd-1338-489a-be58-6aa499f538dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:31.154648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f989efd-1338-489a-be58-6aa499f538dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:31.156068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f989efd-1338-489a-be58-6aa499f538dc service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:31.165657 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 770/1533] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:22:31 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:22:34.495708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893427f-97c7-4545-a851-a5a37f25bb5e None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:34.496310 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893427f-97c7-4545-a851-a5a37f25bb5e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:34.496310 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893427f-97c7-4545-a851-a5a37f25bb5e None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:34.497671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:22:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:22:34.502837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5693252-012b-4066-9968-c65f1b5a9b07 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:34.503268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5693252-012b-4066-9968-c65f1b5a9b07 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:34.503370 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5693252-012b-4066-9968-c65f1b5a9b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:34.511181 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=81 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:34.523918 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a5693252-012b-4066-9968-c65f1b5a9b07 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:34.525134 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a5693252-012b-4066-9968-c65f1b5a9b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:34.532779 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:22:34 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:35.079516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893427f-97c7-4545-a851-a5a37f25bb5e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:35.081218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3893427f-97c7-4545-a851-a5a37f25bb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:35.146237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:35.160179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893427f-97c7-4545-a851-a5a37f25bb5e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:35.163874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b66e99-2055-449b-ae2e-f7fa0f6ee3e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8937ae9f5c7840a2a5af5f851d02ea77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:35.164660 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b66e99-2055-449b-ae2e-f7fa0f6ee3e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:35.164941 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b66e99-2055-449b-ae2e-f7fa0f6ee3e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:35.165211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b66e99-2055-449b-ae2e-f7fa0f6ee3e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:35.174403 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b66e99-2055-449b-ae2e-f7fa0f6ee3e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:35.175915 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b66e99-2055-449b-ae2e-f7fa0f6ee3e8 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:35.185197 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 765/1536] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:22:35 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:22:37.121267 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372baf0-afcb-452e-b507-6e2340b51a3f None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:37.121815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372baf0-afcb-452e-b507-6e2340b51a3f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:37.121815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372baf0-afcb-452e-b507-6e2340b51a3f None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:37.123167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:22:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:22:37.128292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ddfd8-7c5e-4298-a4c9-33dab3b668e2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:37.128772 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ddfd8-7c5e-4298-a4c9-33dab3b668e2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:37.128877 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ddfd8-7c5e-4298-a4c9-33dab3b668e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:37.148632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c26ddfd8-7c5e-4298-a4c9-33dab3b668e2 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:37.149851 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c26ddfd8-7c5e-4298-a4c9-33dab3b668e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:37.157668 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:22:37 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:37.711274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372baf0-afcb-452e-b507-6e2340b51a3f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:37.713039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a372baf0-afcb-452e-b507-6e2340b51a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:37.726577 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372baf0-afcb-452e-b507-6e2340b51a3f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:37.730234 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5093d-ef75-42e5-98d9-417f0462abf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8937ae9f5c7840a2a5af5f851d02ea77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:37.730829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5093d-ef75-42e5-98d9-417f0462abf9 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:37.731107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5093d-ef75-42e5-98d9-417f0462abf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:37.731380 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5093d-ef75-42e5-98d9-417f0462abf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:37.740351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5093d-ef75-42e5-98d9-417f0462abf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:37.742650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5093d-ef75-42e5-98d9-417f0462abf9 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:37.751916 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 773/1539] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:22:37 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:22:47.143801 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=11 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:47.747830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=8 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:23:53.972861 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c43c5-4cc8-4cc4-931c-c25c363aa7c3 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:53.973471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c43c5-4cc8-4cc4-931c-c25c363aa7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:53.973471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c43c5-4cc8-4cc4-931c-c25c363aa7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:53.993894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3d2c43c5-4cc8-4cc4-931c-c25c363aa7c3 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:53.995339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3d2c43c5-4cc8-4cc4-931c-c25c363aa7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:53.997435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc5441-d153-4be2-9b42-c7b8434e48e5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:53.997898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc5441-d153-4be2-9b42-c7b8434e48e5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:53.998007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc5441-d153-4be2-9b42-c7b8434e48e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.003474 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 767/1540] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:23:53 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:54.012388 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b168c3-b4a2-4c03-aa61-9b29a69f61ef None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.012717 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b168c3-b4a2-4c03-aa61-9b29a69f61ef None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.012993 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b168c3-b4a2-4c03-aa61-9b29a69f61ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.018091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4bbc5441-d153-4be2-9b42-c7b8434e48e5 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:54.019296 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4bbc5441-d153-4be2-9b42-c7b8434e48e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:54.028122 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 774/1541] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:23:53 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:23:54.032775 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-86b168c3-b4a2-4c03-aa61-9b29a69f61ef None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:54.033959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-86b168c3-b4a2-4c03-aa61-9b29a69f61ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:54.036085 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d695df-68f2-4031-a48a-4d6e5c77349c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.036361 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d695df-68f2-4031-a48a-4d6e5c77349c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.036653 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d695df-68f2-4031-a48a-4d6e5c77349c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.042399 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 768/1542] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:23:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:23:54.046688 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b168c3-b4a2-4c03-aa61-9b29a69f61ef None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:54.055426 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b168c3-b4a2-4c03-aa61-9b29a69f61ef None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:54.056723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-67d695df-68f2-4031-a48a-4d6e5c77349c None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:54.057950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-67d695df-68f2-4031-a48a-4d6e5c77349c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:54.060097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c74438-5266-4b36-91f6-676c539e6967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:54.060705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c74438-5266-4b36-91f6-676c539e6967 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.060980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c74438-5266-4b36-91f6-676c539e6967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.061245 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c74438-5266-4b36-91f6-676c539e6967 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.061876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c74438-5266-4b36-91f6-676c539e6967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:23:54.062177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c74438-5266-4b36-91f6-676c539e6967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:54.063739 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c74438-5266-4b36-91f6-676c539e6967 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:54.065842 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 775/1543] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:23:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:23:54.070431 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d695df-68f2-4031-a48a-4d6e5c77349c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:54.082580 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 769/1544] 10.222.0.107 () {58 vars in 1158 bytes} [Tue Aug 23 23:23:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:23:54.082755 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d695df-68f2-4031-a48a-4d6e5c77349c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:54.083530 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c74438-5266-4b36-91f6-676c539e6967 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:54.085032 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90978e13-b085-49a2-a4d4-df8bae63d50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:54.085629 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90978e13-b085-49a2-a4d4-df8bae63d50a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.085910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90978e13-b085-49a2-a4d4-df8bae63d50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.086184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90978e13-b085-49a2-a4d4-df8bae63d50a admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.087397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90978e13-b085-49a2-a4d4-df8bae63d50a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:23:54.087709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90978e13-b085-49a2-a4d4-df8bae63d50a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:54.088740 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: WARNING py.warnings [None req-90978e13-b085-49a2-a4d4-df8bae63d50a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:23:54.088740 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: warnings.warn(msg) Aug 23 23:23:54.088740 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: Aug 23 23:23:54.089624 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90978e13-b085-49a2-a4d4-df8bae63d50a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:54.094580 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c74438-5266-4b36-91f6-676c539e6967 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:54.099836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a36c4-2b9c-46c9-a8a2-b24e50814f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:54.100450 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a36c4-2b9c-46c9-a8a2-b24e50814f7d admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.100772 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a36c4-2b9c-46c9-a8a2-b24e50814f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.101047 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a36c4-2b9c-46c9-a8a2-b24e50814f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.101301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 776/1545] 10.222.0.107 () {58 vars in 1158 bytes} [Tue Aug 23 23:23:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:23:54.101669 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a36c4-2b9c-46c9-a8a2-b24e50814f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:54.102743 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: WARNING py.warnings [None req-124a36c4-2b9c-46c9-a8a2-b24e50814f7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:23:54.102743 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: warnings.warn(msg) Aug 23 23:23:54.102743 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: Aug 23 23:23:54.104171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a36c4-2b9c-46c9-a8a2-b24e50814f7d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:54.109331 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90978e13-b085-49a2-a4d4-df8bae63d50a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:54.118892 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90978e13-b085-49a2-a4d4-df8bae63d50a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:54.123505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c5855-9897-4588-865a-8f802f2aea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:54.124088 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c5855-9897-4588-865a-8f802f2aea5c admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.124368 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c5855-9897-4588-865a-8f802f2aea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.124667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c5855-9897-4588-865a-8f802f2aea5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.125292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c5855-9897-4588-865a-8f802f2aea5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:54.127196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c5855-9897-4588-865a-8f802f2aea5c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:54.144677 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 770/1546] 10.222.0.107 () {60 vars in 1158 bytes} [Tue Aug 23 23:23:54 2022] POST /identity/v3/projects => generated 384 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:23:54.145646 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a36c4-2b9c-46c9-a8a2-b24e50814f7d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:54.158351 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 777/1547] 10.222.0.107 () {60 vars in 1158 bytes} [Tue Aug 23 23:23:54 2022] POST /identity/v3/projects => generated 378 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:23:54.162648 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c5855-9897-4588-865a-8f802f2aea5c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:54.210207 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a36c4-2b9c-46c9-a8a2-b24e50814f7d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:54.225038 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c5855-9897-4588-865a-8f802f2aea5c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:54.230512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2915ed-98c8-4272-8052-e96f518c3e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:54.231112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2915ed-98c8-4272-8052-e96f518c3e42 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.231391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2915ed-98c8-4272-8052-e96f518c3e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.231666 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2915ed-98c8-4272-8052-e96f518c3e42 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.232280 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2915ed-98c8-4272-8052-e96f518c3e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:54.233328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: WARNING py.warnings [None req-dc2915ed-98c8-4272-8052-e96f518c3e42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:23:54.233328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: warnings.warn(msg) Aug 23 23:23:54.233328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: Aug 23 23:23:54.234545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2915ed-98c8-4272-8052-e96f518c3e42 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:54.260326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 778/1548] 10.222.0.107 () {60 vars in 1149 bytes} [Tue Aug 23 23:23:54 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:23:54.261418 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2915ed-98c8-4272-8052-e96f518c3e42 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:54.270862 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245eba2d-f7da-4341-9040-fbd4601f0ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:54.271043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2915ed-98c8-4272-8052-e96f518c3e42 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:54.271468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eba2d-f7da-4341-9040-fbd4601f0ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.271741 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eba2d-f7da-4341-9040-fbd4601f0ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.272024 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eba2d-f7da-4341-9040-fbd4601f0ae4 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.272652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245eba2d-f7da-4341-9040-fbd4601f0ae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:54.274709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245eba2d-f7da-4341-9040-fbd4601f0ae4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:54.275791 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bc0a3-48fc-4e95-a4e8-cd425dc7465b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:54.276378 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bc0a3-48fc-4e95-a4e8-cd425dc7465b admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.276694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bc0a3-48fc-4e95-a4e8-cd425dc7465b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.276971 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bc0a3-48fc-4e95-a4e8-cd425dc7465b admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.277613 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bc0a3-48fc-4e95-a4e8-cd425dc7465b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:54.279210 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bc0a3-48fc-4e95-a4e8-cd425dc7465b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:54.290178 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 779/1549] 10.222.0.107 () {58 vars in 1127 bytes} [Tue Aug 23 23:23:54 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:23:54.295621 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 771/1550] 10.222.0.107 () {60 vars in 1149 bytes} [Tue Aug 23 23:23:54 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:23:54.296512 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bc0a3-48fc-4e95-a4e8-cd425dc7465b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:54.299527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245eba2d-f7da-4341-9040-fbd4601f0ae4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:54.306735 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bc0a3-48fc-4e95-a4e8-cd425dc7465b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:54.310041 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245eba2d-f7da-4341-9040-fbd4601f0ae4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:54.311399 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef454e4-2395-4968-b6f1-ee99f1ff3c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:54.311974 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef454e4-2395-4968-b6f1-ee99f1ff3c76 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.312280 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef454e4-2395-4968-b6f1-ee99f1ff3c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.312553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef454e4-2395-4968-b6f1-ee99f1ff3c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.313357 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef454e4-2395-4968-b6f1-ee99f1ff3c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:54.314794 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39296f47-5cde-4114-8943-f8b371f21044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:54.314955 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef454e4-2395-4968-b6f1-ee99f1ff3c76 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:54.315377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39296f47-5cde-4114-8943-f8b371f21044 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.315659 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39296f47-5cde-4114-8943-f8b371f21044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.315931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39296f47-5cde-4114-8943-f8b371f21044 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.316562 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39296f47-5cde-4114-8943-f8b371f21044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:54.318196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39296f47-5cde-4114-8943-f8b371f21044 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:54.326872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 780/1551] 10.222.0.107 () {58 vars in 1127 bytes} [Tue Aug 23 23:23:54 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:23:54.330534 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 772/1552] 10.222.0.107 () {58 vars in 1127 bytes} [Tue Aug 23 23:23:54 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:23:54.330921 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef454e4-2395-4968-b6f1-ee99f1ff3c76 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:54.334268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39296f47-5cde-4114-8943-f8b371f21044 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:54.341430 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef454e4-2395-4968-b6f1-ee99f1ff3c76 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:54.346333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7938c2-f639-4279-9731-d52587cc82f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:54.346681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39296f47-5cde-4114-8943-f8b371f21044 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:54.346968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7938c2-f639-4279-9731-d52587cc82f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.347268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7938c2-f639-4279-9731-d52587cc82f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.347499 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7938c2-f639-4279-9731-d52587cc82f2 admin admin] PATH_INFO: `/v3/projects/f121206e3cb14707b3a4b54bc30c5934/users/a7c6e861b3094d85897ce95bc3a868aa/roles/6be1975947cd4b948b86c73132244927` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.353177 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c11921-0df6-4f85-b824-3e74251195ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:54.353774 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c11921-0df6-4f85-b824-3e74251195ec admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.354154 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c11921-0df6-4f85-b824-3e74251195ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.355829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c11921-0df6-4f85-b824-3e74251195ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.355829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c11921-0df6-4f85-b824-3e74251195ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:54.356555 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c11921-0df6-4f85-b824-3e74251195ec admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:54.363783 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7938c2-f639-4279-9731-d52587cc82f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f121206e3cb14707b3a4b54bc30c5934, user_id=a7c6e861b3094d85897ce95bc3a868aa, role_id=6be1975947cd4b948b86c73132244927)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:54.366487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7938c2-f639-4279-9731-d52587cc82f2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:54.367450 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 773/1553] 10.222.0.107 () {58 vars in 1127 bytes} [Tue Aug 23 23:23:54 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:23:54.372191 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c11921-0df6-4f85-b824-3e74251195ec admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:54.380284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 781/1554] 10.222.0.107 () {60 vars in 1488 bytes} [Tue Aug 23 23:23:54 2022] PUT /identity/v3/projects/f121206e3cb14707b3a4b54bc30c5934/users/a7c6e861b3094d85897ce95bc3a868aa/roles/6be1975947cd4b948b86c73132244927 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:23:54.382163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c11921-0df6-4f85-b824-3e74251195ec admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:54.386324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7ca75-14fb-41b6-ab30-8e218113fe22 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.386610 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7ca75-14fb-41b6-ab30-8e218113fe22 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.386890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7ca75-14fb-41b6-ab30-8e218113fe22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.396015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:23:54.406943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-80d7ca75-14fb-41b6-ab30-8e218113fe22 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:54.408159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-80d7ca75-14fb-41b6-ab30-8e218113fe22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:54.442507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb74ae9-5b45-4610-b361-fafc3e75132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:54.443475 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb74ae9-5b45-4610-b361-fafc3e75132f admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.443747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb74ae9-5b45-4610-b361-fafc3e75132f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.444017 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb74ae9-5b45-4610-b361-fafc3e75132f admin admin] PATH_INFO: `/v3/projects/9d55c2c8a7cc4890a9e4266fe003b99f/users/04d040da00ab4244896122cd0b958801/roles/6be1975947cd4b948b86c73132244927` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.458782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb74ae9-5b45-4610-b361-fafc3e75132f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d55c2c8a7cc4890a9e4266fe003b99f, user_id=04d040da00ab4244896122cd0b958801, role_id=6be1975947cd4b948b86c73132244927)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:54.459113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:23:54.459818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: WARNING py.warnings [None req-1fb74ae9-5b45-4610-b361-fafc3e75132f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:23:54.459818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: warnings.warn(msg) Aug 23 23:23:54.459818 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: Aug 23 23:23:54.461942 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb74ae9-5b45-4610-b361-fafc3e75132f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:54.473311 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 782/1555] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:23:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:54.475323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 774/1556] 10.222.0.107 () {60 vars in 1488 bytes} [Tue Aug 23 23:23:54 2022] PUT /identity/v3/projects/9d55c2c8a7cc4890a9e4266fe003b99f/users/04d040da00ab4244896122cd0b958801/roles/6be1975947cd4b948b86c73132244927 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:23:54.480584 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dab20-5bfa-4266-9588-9dea7255baf7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.480940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dab20-5bfa-4266-9588-9dea7255baf7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.481220 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dab20-5bfa-4266-9588-9dea7255baf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.484211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb74ae9-5b45-4610-b361-fafc3e75132f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:54.500527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5a4dab20-5bfa-4266-9588-9dea7255baf7 None None] MFA Rules not processed for user `7dbee4330ce74aedb00eece717c969c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:54.501764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5a4dab20-5bfa-4266-9588-9dea7255baf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:54.540764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb74ae9-5b45-4610-b361-fafc3e75132f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:54.544853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac945497-f954-43fc-9514-532bdbb80ffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:54.545451 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac945497-f954-43fc-9514-532bdbb80ffb service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.545960 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac945497-f954-43fc-9514-532bdbb80ffb service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.545960 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac945497-f954-43fc-9514-532bdbb80ffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.562890 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 783/1557] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:23:54 2022] POST /identity/v3/auth/tokens => generated 3249 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:54.572947 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dab20-5bfa-4266-9588-9dea7255baf7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:54.581889 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dab20-5bfa-4266-9588-9dea7255baf7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:54.585639 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43b6e5-ac4b-4e61-8128-94c4a3db9b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:54.586239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43b6e5-ac4b-4e61-8128-94c4a3db9b1e service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:54.586516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43b6e5-ac4b-4e61-8128-94c4a3db9b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:54.586845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43b6e5-ac4b-4e61-8128-94c4a3db9b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:54.596114 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43b6e5-ac4b-4e61-8128-94c4a3db9b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:54.597567 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43b6e5-ac4b-4e61-8128-94c4a3db9b1e service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:54.607274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac945497-f954-43fc-9514-532bdbb80ffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:54.607875 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 784/1558] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:23:54 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:23:54.608929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac945497-f954-43fc-9514-532bdbb80ffb service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:54.619396 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 775/1559] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:23:54 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:23:59.958758 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc44b0f-a586-4294-98be-f86a4ad2b305 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:59.960109 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc44b0f-a586-4294-98be-f86a4ad2b305 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:59.961080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc44b0f-a586-4294-98be-f86a4ad2b305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:00.016272 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2dc44b0f-a586-4294-98be-f86a4ad2b305 None None] MFA Rules not processed for user `a7c6e861b3094d85897ce95bc3a868aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:00.017681 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2dc44b0f-a586-4294-98be-f86a4ad2b305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:00.139875 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac945497-f954-43fc-9514-532bdbb80ffb service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:00.140792 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 785/1560] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:23:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:00.152130 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac945497-f954-43fc-9514-532bdbb80ffb service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:00.157511 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1668944-e758-46fa-912c-f6a1fe0a5942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:00.157856 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1668944-e758-46fa-912c-f6a1fe0a5942 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:00.158132 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1668944-e758-46fa-912c-f6a1fe0a5942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:00.158398 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1668944-e758-46fa-912c-f6a1fe0a5942 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:00.159033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1668944-e758-46fa-912c-f6a1fe0a5942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:00.160993 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1668944-e758-46fa-912c-f6a1fe0a5942 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:00.210343 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 776/1561] 10.222.0.107 () {60 vars in 1158 bytes} [Tue Aug 23 23:24:00 2022] POST /identity/v3/projects => generated 380 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:24:00.212822 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc44b0f-a586-4294-98be-f86a4ad2b305 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:00.232437 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc44b0f-a586-4294-98be-f86a4ad2b305 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:00.361830 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a3bb4-3c97-497e-9517-bf7092dc0a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:00.362547 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a3bb4-3c97-497e-9517-bf7092dc0a99 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:00.362895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a3bb4-3c97-497e-9517-bf7092dc0a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:00.363570 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a3bb4-3c97-497e-9517-bf7092dc0a99 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:00.365072 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a3bb4-3c97-497e-9517-bf7092dc0a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:00.367170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a3bb4-3c97-497e-9517-bf7092dc0a99 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:00.402802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 786/1562] 10.222.0.107 () {60 vars in 1149 bytes} [Tue Aug 23 23:24:00 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:24:00.403015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1668944-e758-46fa-912c-f6a1fe0a5942 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:00.418026 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1668944-e758-46fa-912c-f6a1fe0a5942 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:00.431308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b788da5-3b13-4af5-8bba-bba9d197a223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:00.432266 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b788da5-3b13-4af5-8bba-bba9d197a223 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:00.432674 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b788da5-3b13-4af5-8bba-bba9d197a223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:00.433348 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b788da5-3b13-4af5-8bba-bba9d197a223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:00.434137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b788da5-3b13-4af5-8bba-bba9d197a223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:00.437527 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b788da5-3b13-4af5-8bba-bba9d197a223 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:00.462388 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 777/1563] 10.222.0.107 () {58 vars in 1127 bytes} [Tue Aug 23 23:24:00 2022] GET /identity/v3/roles => generated 1427 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:24:00.463930 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a3bb4-3c97-497e-9517-bf7092dc0a99 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:00.469333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:00.502319 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a3bb4-3c97-497e-9517-bf7092dc0a99 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:00.510677 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f666c-d6ca-4a69-b482-ce8ca2226428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:00.511747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f666c-d6ca-4a69-b482-ce8ca2226428 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:00.514391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f666c-d6ca-4a69-b482-ce8ca2226428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:00.515169 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f666c-d6ca-4a69-b482-ce8ca2226428 admin admin] PATH_INFO: `/v3/projects/fc0c25ea610d46be8b57bbd9bf2071f6/users/b903b0c5595347c3ae6f137f6417c5de/roles/97ece22f2e264e0e857d5107325a85d9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:00.539870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f666c-d6ca-4a69-b482-ce8ca2226428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0c25ea610d46be8b57bbd9bf2071f6, user_id=b903b0c5595347c3ae6f137f6417c5de, role_id=97ece22f2e264e0e857d5107325a85d9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:00.546382 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f666c-d6ca-4a69-b482-ce8ca2226428 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:00.558494 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7bf71-622d-4e13-82e0-1777102e9d1a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:00.560027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7bf71-622d-4e13-82e0-1777102e9d1a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:00.560027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7bf71-622d-4e13-82e0-1777102e9d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:00.581980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 787/1564] 10.222.0.107 () {60 vars in 1488 bytes} [Tue Aug 23 23:24:00 2022] PUT /identity/v3/projects/fc0c25ea610d46be8b57bbd9bf2071f6/users/b903b0c5595347c3ae6f137f6417c5de/roles/97ece22f2e264e0e857d5107325a85d9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:24:00.582803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f666c-d6ca-4a69-b482-ce8ca2226428 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:00.598559 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-93d7bf71-622d-4e13-82e0-1777102e9d1a None None] MFA Rules not processed for user `04d040da00ab4244896122cd0b958801`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:00.599798 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-93d7bf71-622d-4e13-82e0-1777102e9d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:00.606183 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:00.666631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f666c-d6ca-4a69-b482-ce8ca2226428 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:00.672080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b58ee-9084-426f-b4a4-24fa2fa3c494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:00.672963 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b58ee-9084-426f-b4a4-24fa2fa3c494 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:00.674098 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b58ee-9084-426f-b4a4-24fa2fa3c494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:00.674463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b58ee-9084-426f-b4a4-24fa2fa3c494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:00.675488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b58ee-9084-426f-b4a4-24fa2fa3c494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:00.677332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b58ee-9084-426f-b4a4-24fa2fa3c494 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:00.688391 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 778/1565] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:24:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:00.689355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7bf71-622d-4e13-82e0-1777102e9d1a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:00.693057 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 788/1566] 10.222.0.107 () {58 vars in 1127 bytes} [Tue Aug 23 23:24:00 2022] GET /identity/v3/roles => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:24:00.695575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b58ee-9084-426f-b4a4-24fa2fa3c494 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:00.711138 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b58ee-9084-426f-b4a4-24fa2fa3c494 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:00.712409 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7bf71-622d-4e13-82e0-1777102e9d1a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:00.717127 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9db8c-4afa-4e59-8517-fce6438a0807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:00.717922 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9db8c-4afa-4e59-8517-fce6438a0807 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:00.718504 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9db8c-4afa-4e59-8517-fce6438a0807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:00.718793 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9db8c-4afa-4e59-8517-fce6438a0807 admin admin] PATH_INFO: `/v3/projects/fc0c25ea610d46be8b57bbd9bf2071f6/users/b903b0c5595347c3ae6f137f6417c5de/roles/97ece22f2e264e0e857d5107325a85d9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:00.720943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9db8c-4afa-4e59-8517-fce6438a0807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0c25ea610d46be8b57bbd9bf2071f6, user_id=b903b0c5595347c3ae6f137f6417c5de, role_id=97ece22f2e264e0e857d5107325a85d9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:00.721100 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70331d-3303-432b-b967-44f29b0b2190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:00.721719 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70331d-3303-432b-b967-44f29b0b2190 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:00.721992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70331d-3303-432b-b967-44f29b0b2190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:00.722845 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70331d-3303-432b-b967-44f29b0b2190 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:00.723483 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70331d-3303-432b-b967-44f29b0b2190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:00.723593 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9db8c-4afa-4e59-8517-fce6438a0807 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:00.725650 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70331d-3303-432b-b967-44f29b0b2190 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:00.735326 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 789/1567] 10.222.0.107 () {60 vars in 1488 bytes} [Tue Aug 23 23:24:00 2022] PUT /identity/v3/projects/fc0c25ea610d46be8b57bbd9bf2071f6/users/b903b0c5595347c3ae6f137f6417c5de/roles/97ece22f2e264e0e857d5107325a85d9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:24:00.764642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 779/1568] 10.222.0.107 () {60 vars in 1158 bytes} [Tue Aug 23 23:24:00 2022] POST /identity/v3/projects => generated 386 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:24:00.767139 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9db8c-4afa-4e59-8517-fce6438a0807 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:00.856566 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9db8c-4afa-4e59-8517-fce6438a0807 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:00.932582 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c148c-56f0-4815-a2fe-82aac20ff417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:00.933374 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c148c-56f0-4815-a2fe-82aac20ff417 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:00.934432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c148c-56f0-4815-a2fe-82aac20ff417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:00.934432 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c148c-56f0-4815-a2fe-82aac20ff417 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:00.934776 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c148c-56f0-4815-a2fe-82aac20ff417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:00.936898 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c148c-56f0-4815-a2fe-82aac20ff417 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:00.957635 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:00.975786 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 790/1569] 10.222.0.107 () {60 vars in 1149 bytes} [Tue Aug 23 23:24:00 2022] POST /identity/v3/users => generated 300 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:24:00.988803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70331d-3303-432b-b967-44f29b0b2190 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:01.007463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70331d-3303-432b-b967-44f29b0b2190 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:01.015329 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf87561-ff4b-4bbc-ad83-ea9bfea494de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:01.015969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf87561-ff4b-4bbc-ad83-ea9bfea494de admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:01.016244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf87561-ff4b-4bbc-ad83-ea9bfea494de admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:01.016545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf87561-ff4b-4bbc-ad83-ea9bfea494de admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:01.017305 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf87561-ff4b-4bbc-ad83-ea9bfea494de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:01.018959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf87561-ff4b-4bbc-ad83-ea9bfea494de admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:01.038925 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 780/1570] 10.222.0.107 () {58 vars in 1127 bytes} [Tue Aug 23 23:24:00 2022] GET /identity/v3/roles => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:24:01.043431 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c148c-56f0-4815-a2fe-82aac20ff417 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:01.057519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c148c-56f0-4815-a2fe-82aac20ff417 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:01.063052 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5367104-5645-4a12-bf3a-26d70035432d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:01.063913 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5367104-5645-4a12-bf3a-26d70035432d admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:01.064209 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5367104-5645-4a12-bf3a-26d70035432d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:01.064468 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5367104-5645-4a12-bf3a-26d70035432d admin admin] PATH_INFO: `/v3/projects/c14872a12d054275ae316c504eab07a8/users/1574635b7d8141989a7906515cbc0fe5/roles/97ece22f2e264e0e857d5107325a85d9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:01.088882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5367104-5645-4a12-bf3a-26d70035432d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14872a12d054275ae316c504eab07a8, user_id=1574635b7d8141989a7906515cbc0fe5, role_id=97ece22f2e264e0e857d5107325a85d9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:01.091919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5367104-5645-4a12-bf3a-26d70035432d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:01.112967 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 791/1571] 10.222.0.107 () {60 vars in 1488 bytes} [Tue Aug 23 23:24:01 2022] PUT /identity/v3/projects/c14872a12d054275ae316c504eab07a8/users/1574635b7d8141989a7906515cbc0fe5/roles/97ece22f2e264e0e857d5107325a85d9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:24:01.116091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf87561-ff4b-4bbc-ad83-ea9bfea494de admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:01.131103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf87561-ff4b-4bbc-ad83-ea9bfea494de admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:01.202472 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e1a17-77f2-4f43-973f-81fd6d944eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:01.203883 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e1a17-77f2-4f43-973f-81fd6d944eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:01.204439 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e1a17-77f2-4f43-973f-81fd6d944eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:01.204965 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e1a17-77f2-4f43-973f-81fd6d944eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:01.205780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e1a17-77f2-4f43-973f-81fd6d944eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:01.207575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e1a17-77f2-4f43-973f-81fd6d944eb5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:01.233422 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 781/1572] 10.222.0.107 () {58 vars in 1127 bytes} [Tue Aug 23 23:24:01 2022] GET /identity/v3/roles => generated 1427 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:24:01.242644 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5367104-5645-4a12-bf3a-26d70035432d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:01.280705 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5367104-5645-4a12-bf3a-26d70035432d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:01.288034 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9767fae-496d-43cb-9f57-5cb8b6ac2f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:01.290759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9767fae-496d-43cb-9f57-5cb8b6ac2f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:01.291340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9767fae-496d-43cb-9f57-5cb8b6ac2f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:01.291615 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9767fae-496d-43cb-9f57-5cb8b6ac2f4c admin admin] PATH_INFO: `/v3/projects/c14872a12d054275ae316c504eab07a8/users/1574635b7d8141989a7906515cbc0fe5/roles/97ece22f2e264e0e857d5107325a85d9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:01.294218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9767fae-496d-43cb-9f57-5cb8b6ac2f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14872a12d054275ae316c504eab07a8, user_id=1574635b7d8141989a7906515cbc0fe5, role_id=97ece22f2e264e0e857d5107325a85d9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:01.297387 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9767fae-496d-43cb-9f57-5cb8b6ac2f4c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:01.315354 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 792/1573] 10.222.0.107 () {60 vars in 1488 bytes} [Tue Aug 23 23:24:01 2022] PUT /identity/v3/projects/c14872a12d054275ae316c504eab07a8/users/1574635b7d8141989a7906515cbc0fe5/roles/97ece22f2e264e0e857d5107325a85d9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:24:06.727940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4cc9e-439e-4ddf-b1ef-fdb4c65529c6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:06.728796 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4cc9e-439e-4ddf-b1ef-fdb4c65529c6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:06.730805 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4cc9e-439e-4ddf-b1ef-fdb4c65529c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:06.786781 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-13e4cc9e-439e-4ddf-b1ef-fdb4c65529c6 None None] MFA Rules not processed for user `b903b0c5595347c3ae6f137f6417c5de`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:06.788293 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-13e4cc9e-439e-4ddf-b1ef-fdb4c65529c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:06.880268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:06.897927 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 782/1574] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:24:06 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:06.910203 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9767fae-496d-43cb-9f57-5cb8b6ac2f4c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:06.912545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b9767fae-496d-43cb-9f57-5cb8b6ac2f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:07.044464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9767fae-496d-43cb-9f57-5cb8b6ac2f4c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:07.050461 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a69b02-cc68-497f-b250-940b5bdce8b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43ac193836248959a0380a76549ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:07.051189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a69b02-cc68-497f-b250-940b5bdce8b5 service glance] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:07.051529 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a69b02-cc68-497f-b250-940b5bdce8b5 service glance] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:07.051863 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a69b02-cc68-497f-b250-940b5bdce8b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:07.179901 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a69b02-cc68-497f-b250-940b5bdce8b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:07.184875 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a69b02-cc68-497f-b250-940b5bdce8b5 service glance] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:07.217236 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 793/1575] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:24:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:07.297444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfda91-1bd7-4e4a-8df1-34dbe779cee7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:07.297949 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfda91-1bd7-4e4a-8df1-34dbe779cee7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:07.298355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfda91-1bd7-4e4a-8df1-34dbe779cee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:07.376036 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-04bfda91-1bd7-4e4a-8df1-34dbe779cee7 None None] MFA Rules not processed for user `1574635b7d8141989a7906515cbc0fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:07.378092 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-04bfda91-1bd7-4e4a-8df1-34dbe779cee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:07.558068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 783/1576] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:24:07 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:07.567415 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a69b02-cc68-497f-b250-940b5bdce8b5 service glance] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:07.570677 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e6a69b02-cc68-497f-b250-940b5bdce8b5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:07.603593 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a69b02-cc68-497f-b250-940b5bdce8b5 service glance] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:07.609920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036eea2-f6a8-4bf0-825c-881a11a55074 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43ac193836248959a0380a76549ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:07.611284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036eea2-f6a8-4bf0-825c-881a11a55074 service glance] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:07.611759 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036eea2-f6a8-4bf0-825c-881a11a55074 service glance] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:07.612216 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036eea2-f6a8-4bf0-825c-881a11a55074 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:07.734950 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:07.739308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036eea2-f6a8-4bf0-825c-881a11a55074 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:07.741099 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036eea2-f6a8-4bf0-825c-881a11a55074 service glance] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:07.752960 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 794/1577] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:24:07 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:07.967453 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3667a-43bc-4432-9e9c-e87cb523a0cb None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:07.967965 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3667a-43bc-4432-9e9c-e87cb523a0cb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:07.970841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3667a-43bc-4432-9e9c-e87cb523a0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:08.055575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-44a3667a-43bc-4432-9e9c-e87cb523a0cb None None] MFA Rules not processed for user `238ad0efedfd4cd89d99e2abebaeba63`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:08.057370 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-44a3667a-43bc-4432-9e9c-e87cb523a0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:08.169641 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 784/1578] 10.222.0.107 () {58 vars in 1014 bytes} [Tue Aug 23 23:24:07 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:08.312033 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036eea2-f6a8-4bf0-825c-881a11a55074 service glance] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:08.313567 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b036eea2-f6a8-4bf0-825c-881a11a55074 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:08.440586 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036eea2-f6a8-4bf0-825c-881a11a55074 service glance] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:08.446996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd75686-e7b3-46fa-81fe-d6e0ffebe2f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d0b95b22bc4117957cbc3afa5547a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:08.448051 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd75686-e7b3-46fa-81fe-d6e0ffebe2f0 service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:08.448051 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd75686-e7b3-46fa-81fe-d6e0ffebe2f0 service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:08.448407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd75686-e7b3-46fa-81fe-d6e0ffebe2f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:08.458002 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd75686-e7b3-46fa-81fe-d6e0ffebe2f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:08.459814 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd75686-e7b3-46fa-81fe-d6e0ffebe2f0 service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:08.469148 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 795/1579] 10.222.0.107 () {60 vars in 1389 bytes} [Tue Aug 23 23:24:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 23:24:08.894111 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc945f-9fea-4965-b09a-930f451f5982 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:08.894395 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc945f-9fea-4965-b09a-930f451f5982 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:08.894665 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc945f-9fea-4965-b09a-930f451f5982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:08.929808 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4bdc945f-9fea-4965-b09a-930f451f5982 None None] MFA Rules not processed for user `238ad0efedfd4cd89d99e2abebaeba63`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:08.932091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4bdc945f-9fea-4965-b09a-930f451f5982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:08.944959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 785/1580] 10.222.0.107 () {58 vars in 1014 bytes} [Tue Aug 23 23:24:08 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:08.956359 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd75686-e7b3-46fa-81fe-d6e0ffebe2f0 service swift] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:08.967803 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd75686-e7b3-46fa-81fe-d6e0ffebe2f0 service swift] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:08.979815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb7d8e-4bfd-41c2-b8d8-06a7862380ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d0b95b22bc4117957cbc3afa5547a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:08.984218 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb7d8e-4bfd-41c2-b8d8-06a7862380ab service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:08.984687 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb7d8e-4bfd-41c2-b8d8-06a7862380ab service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:08.985064 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb7d8e-4bfd-41c2-b8d8-06a7862380ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:09.007190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb7d8e-4bfd-41c2-b8d8-06a7862380ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:09.009246 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb7d8e-4bfd-41c2-b8d8-06a7862380ab service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:09.018522 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 796/1581] 10.222.0.107 () {60 vars in 1389 bytes} [Tue Aug 23 23:24:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:24:18.738557 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373ad65-df56-450d-b253-5298037ac604 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:18.739079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373ad65-df56-450d-b253-5298037ac604 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:18.739079 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373ad65-df56-450d-b253-5298037ac604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:18.758563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6373ad65-df56-450d-b253-5298037ac604 None None] MFA Rules not processed for user `04d040da00ab4244896122cd0b958801`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:18.760042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6373ad65-df56-450d-b253-5298037ac604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:18.767248 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 786/1582] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:24:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:19.014587 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=50 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:19.076058 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698b30-cecf-44c6-b829-d77ab774825e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:19.076416 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698b30-cecf-44c6-b829-d77ab774825e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:19.076729 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698b30-cecf-44c6-b829-d77ab774825e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:19.079094 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 797/1583] 10.222.0.107 () {54 vars in 967 bytes} [Tue Aug 23 23:24:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:24:19.084576 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74368153-5e3e-4731-a65f-013df959d9d5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:19.084880 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74368153-5e3e-4731-a65f-013df959d9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:19.085149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74368153-5e3e-4731-a65f-013df959d9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:19.124442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-74368153-5e3e-4731-a65f-013df959d9d5 None None] MFA Rules not processed for user `2f985626d8af4f3089e72998fad98b47`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:19.125688 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-74368153-5e3e-4731-a65f-013df959d9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:19.152298 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:19.202560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 787/1584] 10.222.0.107 () {58 vars in 1064 bytes} [Tue Aug 23 23:24:19 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:19.207956 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d5b94-5295-45c2-892e-4da689d87ebe None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:19.208239 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d5b94-5295-45c2-892e-4da689d87ebe None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:19.208516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d5b94-5295-45c2-892e-4da689d87ebe None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:19.209900 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 798/1585] 10.222.0.107 () {54 vars in 917 bytes} [Tue Aug 23 23:24:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:24:19.215013 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b31445-91ec-474e-87ea-ebeffea0f0c0 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:19.215371 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b31445-91ec-474e-87ea-ebeffea0f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:19.215747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b31445-91ec-474e-87ea-ebeffea0f0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:19.235199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-83b31445-91ec-474e-87ea-ebeffea0f0c0 None None] MFA Rules not processed for user `2f985626d8af4f3089e72998fad98b47`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:19.236344 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-83b31445-91ec-474e-87ea-ebeffea0f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:19.246250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 788/1586] 10.222.0.107 () {58 vars in 1014 bytes} [Tue Aug 23 23:24:19 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:19.257970 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d5b94-5295-45c2-892e-4da689d87ebe None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:19.269982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d5b94-5295-45c2-892e-4da689d87ebe None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:19.273546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35931862-07a8-4895-86be-7a575938255b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43ac193836248959a0380a76549ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:19.274379 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35931862-07a8-4895-86be-7a575938255b service glance] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:19.274726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35931862-07a8-4895-86be-7a575938255b service glance] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:19.275064 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35931862-07a8-4895-86be-7a575938255b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:19.285973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35931862-07a8-4895-86be-7a575938255b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:19.287517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35931862-07a8-4895-86be-7a575938255b service glance] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:19.299807 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 799/1587] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:24:19 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:24:19.648142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a026350-6636-426c-ba2b-2ccf004d82c7 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:19.649031 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a026350-6636-426c-ba2b-2ccf004d82c7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:19.649427 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a026350-6636-426c-ba2b-2ccf004d82c7 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:19.651105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 789/1588] 10.222.0.107 () {54 vars in 917 bytes} [Tue Aug 23 23:24:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:24:19.656607 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b049c-e0eb-4ab5-8de4-9acd45b46ffe None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:19.656921 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b049c-e0eb-4ab5-8de4-9acd45b46ffe None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:19.657206 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b049c-e0eb-4ab5-8de4-9acd45b46ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:19.700206 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f95b049c-e0eb-4ab5-8de4-9acd45b46ffe None None] MFA Rules not processed for user `b88d0d18ad66438191541b84fc1431bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:19.701129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f95b049c-e0eb-4ab5-8de4-9acd45b46ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:19.754837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 800/1589] 10.222.0.107 () {58 vars in 1014 bytes} [Tue Aug 23 23:24:19 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:19.766695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a026350-6636-426c-ba2b-2ccf004d82c7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:19.777958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a026350-6636-426c-ba2b-2ccf004d82c7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:19.781896 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a6e73-7aed-49a7-aee6-5437c996d756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:19.782035 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a6e73-7aed-49a7-aee6-5437c996d756 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:19.782288 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a6e73-7aed-49a7-aee6-5437c996d756 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:19.782553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a6e73-7aed-49a7-aee6-5437c996d756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:19.791098 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a6e73-7aed-49a7-aee6-5437c996d756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:19.792549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a6e73-7aed-49a7-aee6-5437c996d756 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:19.813084 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 790/1590] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:24:19 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:24:20.240152 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278feed2-41cc-4d50-be1c-75b3a14f2cba None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:20.240720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278feed2-41cc-4d50-be1c-75b3a14f2cba None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:20.240720 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278feed2-41cc-4d50-be1c-75b3a14f2cba None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:20.242128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 801/1591] 10.222.0.107 () {54 vars in 967 bytes} [Tue Aug 23 23:24:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:24:20.248237 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c035a62-d772-46b3-b75a-4ac2e736cf83 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:20.248647 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c035a62-d772-46b3-b75a-4ac2e736cf83 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:20.249184 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c035a62-d772-46b3-b75a-4ac2e736cf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:20.271553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1c035a62-d772-46b3-b75a-4ac2e736cf83 None None] MFA Rules not processed for user `2f985626d8af4f3089e72998fad98b47`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:20.273087 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1c035a62-d772-46b3-b75a-4ac2e736cf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:20.280888 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb95412-21b7-479c-be76-48c3ea55ed2c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:20.281745 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb95412-21b7-479c-be76-48c3ea55ed2c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:20.282165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb95412-21b7-479c-be76-48c3ea55ed2c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:20.283885 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 802/1592] 10.222.0.107 () {54 vars in 966 bytes} [Tue Aug 23 23:24:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:24:20.292620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40e375-e9e6-47e6-927e-05bb7284ccea None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:20.293216 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40e375-e9e6-47e6-927e-05bb7284ccea None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:20.294005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40e375-e9e6-47e6-927e-05bb7284ccea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:20.299620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 791/1593] 10.222.0.107 () {58 vars in 1064 bytes} [Tue Aug 23 23:24:20 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:20.306444 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b24006-585c-4659-a659-aadd0575f1b8 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:20.306815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b24006-585c-4659-a659-aadd0575f1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:20.307411 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b24006-585c-4659-a659-aadd0575f1b8 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:20.309723 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 792/1594] 10.222.0.107 () {54 vars in 917 bytes} [Tue Aug 23 23:24:20 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 23 23:24:20.314782 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10153f-d7ad-44b1-81fa-f323834980fc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:20.315064 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10153f-d7ad-44b1-81fa-f323834980fc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:20.315339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10153f-d7ad-44b1-81fa-f323834980fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:20.321114 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ef40e375-e9e6-47e6-927e-05bb7284ccea None None] MFA Rules not processed for user `14ee6ffc0985405193735af49a398326`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:20.322535 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ef40e375-e9e6-47e6-927e-05bb7284ccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:20.335694 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7e10153f-d7ad-44b1-81fa-f323834980fc None None] MFA Rules not processed for user `2f985626d8af4f3089e72998fad98b47`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:20.337457 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7e10153f-d7ad-44b1-81fa-f323834980fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:20.349651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 793/1595] 10.222.0.107 () {58 vars in 1014 bytes} [Tue Aug 23 23:24:20 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:24:20.361753 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10153f-d7ad-44b1-81fa-f323834980fc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:20.362973 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7e10153f-d7ad-44b1-81fa-f323834980fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:20.375947 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10153f-d7ad-44b1-81fa-f323834980fc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:20.380036 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d0301-44b0-4ae5-9712-34bf05d881ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:20.380904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d0301-44b0-4ae5-9712-34bf05d881ee service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:20.381185 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d0301-44b0-4ae5-9712-34bf05d881ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:20.381458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d0301-44b0-4ae5-9712-34bf05d881ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:20.392956 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d0301-44b0-4ae5-9712-34bf05d881ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:20.394540 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d0301-44b0-4ae5-9712-34bf05d881ee service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:20.397308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 803/1596] 10.222.0.107 () {58 vars in 1063 bytes} [Tue Aug 23 23:24:20 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:24:20.405604 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40e375-e9e6-47e6-927e-05bb7284ccea None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:20.415548 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 794/1597] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:24:20 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:24:20.418490 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40e375-e9e6-47e6-927e-05bb7284ccea None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:20.424303 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9859e5f-d5ad-45bf-a40f-cff9dd76d6d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ee6ffc0985405193735af49a398326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:20.425098 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9859e5f-d5ad-45bf-a40f-cff9dd76d6d2 service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:20.425478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9859e5f-d5ad-45bf-a40f-cff9dd76d6d2 service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:20.426372 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9859e5f-d5ad-45bf-a40f-cff9dd76d6d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:20.428032 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c9859e5f-d5ad-45bf-a40f-cff9dd76d6d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:20.440817 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9859e5f-d5ad-45bf-a40f-cff9dd76d6d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:20.442545 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9859e5f-d5ad-45bf-a40f-cff9dd76d6d2 service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:20.457992 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 804/1598] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:24:20 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:24:22.255499 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c48b1-925c-46e4-bc5e-a5132c7df97d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:22.255968 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c48b1-925c-46e4-bc5e-a5132c7df97d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:22.256068 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c48b1-925c-46e4-bc5e-a5132c7df97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:22.275958 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d38c48b1-925c-46e4-bc5e-a5132c7df97d None None] MFA Rules not processed for user `238ad0efedfd4cd89d99e2abebaeba63`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:22.277318 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d38c48b1-925c-46e4-bc5e-a5132c7df97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:22.284466 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 795/1599] 10.222.0.107 () {58 vars in 1014 bytes} [Tue Aug 23 23:24:22 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:22.299442 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9859e5f-d5ad-45bf-a40f-cff9dd76d6d2 service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:22.311555 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9859e5f-d5ad-45bf-a40f-cff9dd76d6d2 service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:22.318191 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423195f-8c4f-41b0-9e1a-986fd017ac63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d0b95b22bc4117957cbc3afa5547a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:22.318807 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423195f-8c4f-41b0-9e1a-986fd017ac63 service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:22.319277 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423195f-8c4f-41b0-9e1a-986fd017ac63 service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:22.319561 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423195f-8c4f-41b0-9e1a-986fd017ac63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:22.338933 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423195f-8c4f-41b0-9e1a-986fd017ac63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:22.340893 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423195f-8c4f-41b0-9e1a-986fd017ac63 service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:22.350282 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 805/1600] 10.222.0.107 () {60 vars in 1389 bytes} [Tue Aug 23 23:24:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:24:30.898996 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656cf6f-a9c1-4044-a819-7bb2ba8d1b3d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:30.899518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656cf6f-a9c1-4044-a819-7bb2ba8d1b3d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:30.899632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656cf6f-a9c1-4044-a819-7bb2ba8d1b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:30.919779 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6656cf6f-a9c1-4044-a819-7bb2ba8d1b3d None None] MFA Rules not processed for user `b88d0d18ad66438191541b84fc1431bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:30.921027 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6656cf6f-a9c1-4044-a819-7bb2ba8d1b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:30.927523 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 796/1601] 10.222.0.93 () {58 vars in 1019 bytes} [Tue Aug 23 23:24:30 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:30.945878 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423195f-8c4f-41b0-9e1a-986fd017ac63 service swift] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:30.954987 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423195f-8c4f-41b0-9e1a-986fd017ac63 service swift] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:30.958628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0de66f-f734-40b9-a9d1-970df95a3cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:30.959242 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0de66f-f734-40b9-a9d1-970df95a3cfd service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:30.959517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0de66f-f734-40b9-a9d1-970df95a3cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:30.959786 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0de66f-f734-40b9-a9d1-970df95a3cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:30.967511 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0de66f-f734-40b9-a9d1-970df95a3cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:30.968969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0de66f-f734-40b9-a9d1-970df95a3cfd service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:30.977600 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 806/1602] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:24:30 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:31.783462 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00301e6-edd3-4157-ba6c-a205b4461363 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:31.783783 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00301e6-edd3-4157-ba6c-a205b4461363 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:31.784137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00301e6-edd3-4157-ba6c-a205b4461363 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:31.785628 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 797/1603] 10.222.0.107 () {54 vars in 926 bytes} [Tue Aug 23 23:24:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:24:31.810688 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903b648-c948-4a68-bbd8-080784669eef None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:31.810979 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903b648-c948-4a68-bbd8-080784669eef None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:31.811257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903b648-c948-4a68-bbd8-080784669eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:31.830831 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8903b648-c948-4a68-bbd8-080784669eef None None] MFA Rules not processed for user `2f985626d8af4f3089e72998fad98b47`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:31.832092 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8903b648-c948-4a68-bbd8-080784669eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:31.841301 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 807/1604] 10.222.0.107 () {58 vars in 1023 bytes} [Tue Aug 23 23:24:31 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:31.877211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00301e6-edd3-4157-ba6c-a205b4461363 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:31.908407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00301e6-edd3-4157-ba6c-a205b4461363 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:31.915093 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8bd3b-ac4c-446f-80ad-764499b4ca2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:31.915710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8bd3b-ac4c-446f-80ad-764499b4ca2b service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:31.916496 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8bd3b-ac4c-446f-80ad-764499b4ca2b service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:31.916852 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8bd3b-ac4c-446f-80ad-764499b4ca2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:31.926676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8bd3b-ac4c-446f-80ad-764499b4ca2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:31.928427 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8bd3b-ac4c-446f-80ad-764499b4ca2b service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:31.943456 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 798/1605] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:24:31 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:24:38.161702 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0f451-13cb-43de-84eb-a58e30914d05 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:38.162302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0f451-13cb-43de-84eb-a58e30914d05 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:38.162302 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0f451-13cb-43de-84eb-a58e30914d05 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:38.164151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 808/1606] 10.222.0.107 () {54 vars in 926 bytes} [Tue Aug 23 23:24:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:24:38.172189 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45e4e8-d389-449c-b742-6664d09896c4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:38.172676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45e4e8-d389-449c-b742-6664d09896c4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:38.172785 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45e4e8-d389-449c-b742-6664d09896c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:38.194780 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0f45e4e8-d389-449c-b742-6664d09896c4 None None] MFA Rules not processed for user `2f985626d8af4f3089e72998fad98b47`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:38.196190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0f45e4e8-d389-449c-b742-6664d09896c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:38.205417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 799/1607] 10.222.0.107 () {58 vars in 1023 bytes} [Tue Aug 23 23:24:38 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:38.217525 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0f451-13cb-43de-84eb-a58e30914d05 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:38.233632 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0f451-13cb-43de-84eb-a58e30914d05 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:38.239447 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cd1e2-a1ad-46c2-a5d8-eeb1881f68f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:38.240130 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cd1e2-a1ad-46c2-a5d8-eeb1881f68f5 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:38.240493 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cd1e2-a1ad-46c2-a5d8-eeb1881f68f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:38.240920 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cd1e2-a1ad-46c2-a5d8-eeb1881f68f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:38.252086 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cd1e2-a1ad-46c2-a5d8-eeb1881f68f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:38.253732 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cd1e2-a1ad-46c2-a5d8-eeb1881f68f5 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:38.264217 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 809/1608] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:24:38 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:48.189910 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=55 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:48.259929 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:59.911695 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45e4e8-d389-449c-b742-6664d09896c4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:59.921771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45e4e8-d389-449c-b742-6664d09896c4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:59.925328 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df073f7f-c87b-4743-bb49-04acc9a46515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:59.925919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df073f7f-c87b-4743-bb49-04acc9a46515 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:59.926196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df073f7f-c87b-4743-bb49-04acc9a46515 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:59.926465 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df073f7f-c87b-4743-bb49-04acc9a46515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:59.935790 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df073f7f-c87b-4743-bb49-04acc9a46515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:59.937250 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df073f7f-c87b-4743-bb49-04acc9a46515 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:59.946445 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 800/1609] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:24:59 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:03.676581 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e80986-abc2-40b0-a0a4-ea603dd61bc5 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:03.677231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e80986-abc2-40b0-a0a4-ea603dd61bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:03.677231 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e80986-abc2-40b0-a0a4-ea603dd61bc5 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:03.679050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 810/1610] 10.222.0.107 () {54 vars in 926 bytes} [Tue Aug 23 23:25:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:25:03.687931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f2d4a-5872-4c5e-bce1-a97ae6273d9b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:03.688876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f2d4a-5872-4c5e-bce1-a97ae6273d9b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:03.689307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f2d4a-5872-4c5e-bce1-a97ae6273d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:03.711385 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e77f2d4a-5872-4c5e-bce1-a97ae6273d9b None None] MFA Rules not processed for user `2f985626d8af4f3089e72998fad98b47`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:03.712919 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e77f2d4a-5872-4c5e-bce1-a97ae6273d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:03.724253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 801/1611] 10.222.0.107 () {58 vars in 1023 bytes} [Tue Aug 23 23:25:03 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:03.739488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e80986-abc2-40b0-a0a4-ea603dd61bc5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:03.760478 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e80986-abc2-40b0-a0a4-ea603dd61bc5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:03.769044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283134e-ddae-46f7-bd63-273697aab90a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:03.770459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283134e-ddae-46f7-bd63-273697aab90a service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:03.770903 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283134e-ddae-46f7-bd63-273697aab90a service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:03.771332 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283134e-ddae-46f7-bd63-273697aab90a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:03.783853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283134e-ddae-46f7-bd63-273697aab90a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:03.785488 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283134e-ddae-46f7-bd63-273697aab90a service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:03.817407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 811/1612] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:25:03 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:12.476522 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3889c8a-f0f5-41d3-86bc-b7b1a645df1c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:12.477010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3889c8a-f0f5-41d3-86bc-b7b1a645df1c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:12.477102 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3889c8a-f0f5-41d3-86bc-b7b1a645df1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:12.496019 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d3889c8a-f0f5-41d3-86bc-b7b1a645df1c None None] MFA Rules not processed for user `a7c6e861b3094d85897ce95bc3a868aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:12.497253 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d3889c8a-f0f5-41d3-86bc-b7b1a645df1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:12.504256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 802/1613] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:25:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:12.844007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f3bb5-a3dc-4616-93dc-58ea2365ab1d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:12.844496 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f3bb5-a3dc-4616-93dc-58ea2365ab1d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:12.844588 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f3bb5-a3dc-4616-93dc-58ea2365ab1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:12.863988 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b26f3bb5-a3dc-4616-93dc-58ea2365ab1d None None] MFA Rules not processed for user `b88d0d18ad66438191541b84fc1431bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:12.865192 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b26f3bb5-a3dc-4616-93dc-58ea2365ab1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:12.872667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 812/1614] 10.222.0.107 () {58 vars in 1014 bytes} [Tue Aug 23 23:25:12 2022] POST /identity/v3/auth/tokens => generated 3131 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:12.886769 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3889c8a-f0f5-41d3-86bc-b7b1a645df1c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:12.897711 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3889c8a-f0f5-41d3-86bc-b7b1a645df1c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:12.901961 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c4110-b37f-41a6-9289-da406a098d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:12.902563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c4110-b37f-41a6-9289-da406a098d90 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:12.903030 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c4110-b37f-41a6-9289-da406a098d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:12.903526 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c4110-b37f-41a6-9289-da406a098d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:12.912807 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c4110-b37f-41a6-9289-da406a098d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:12.914875 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c4110-b37f-41a6-9289-da406a098d90 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:12.923178 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 803/1615] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:25:12 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:22.859317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=9 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:25:22.919700 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=18 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:25:53.040191 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a860e64-1212-4626-b9e0-9bc7f82459e9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:53.040765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a860e64-1212-4626-b9e0-9bc7f82459e9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:53.040765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a860e64-1212-4626-b9e0-9bc7f82459e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:53.062130 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2a860e64-1212-4626-b9e0-9bc7f82459e9 None None] MFA Rules not processed for user `a7c6e861b3094d85897ce95bc3a868aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:53.064170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2a860e64-1212-4626-b9e0-9bc7f82459e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:53.072039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 813/1616] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:25:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:26:03.054223 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:26:09.782009 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20c1b9-3836-4a45-a0c8-f3e66b29b814 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:09.782519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20c1b9-3836-4a45-a0c8-f3e66b29b814 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:09.782607 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20c1b9-3836-4a45-a0c8-f3e66b29b814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:09.802190 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ff20c1b9-3836-4a45-a0c8-f3e66b29b814 None None] MFA Rules not processed for user `238ad0efedfd4cd89d99e2abebaeba63`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:09.803419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ff20c1b9-3836-4a45-a0c8-f3e66b29b814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:09.811238 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 804/1617] 10.222.0.107 () {58 vars in 1014 bytes} [Tue Aug 23 23:26:09 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:26:09.851756 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a860e64-1212-4626-b9e0-9bc7f82459e9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:09.863781 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a860e64-1212-4626-b9e0-9bc7f82459e9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:09.868969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101074a-4b37-499e-a110-34eaa6d1619c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d0b95b22bc4117957cbc3afa5547a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:09.869574 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101074a-4b37-499e-a110-34eaa6d1619c service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:09.869869 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101074a-4b37-499e-a110-34eaa6d1619c service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:09.870125 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101074a-4b37-499e-a110-34eaa6d1619c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:09.879016 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101074a-4b37-499e-a110-34eaa6d1619c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:09.880675 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101074a-4b37-499e-a110-34eaa6d1619c service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:09.888975 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 814/1618] 10.222.0.107 () {60 vars in 1389 bytes} [Tue Aug 23 23:26:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:26:13.215856 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef4f90-9f87-4113-81ad-e9e590d0d9dc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:13.216392 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef4f90-9f87-4113-81ad-e9e590d0d9dc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:13.216905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef4f90-9f87-4113-81ad-e9e590d0d9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:13.238824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-41ef4f90-9f87-4113-81ad-e9e590d0d9dc None None] MFA Rules not processed for user `a7c6e861b3094d85897ce95bc3a868aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:13.240036 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-41ef4f90-9f87-4113-81ad-e9e590d0d9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:13.247497 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 805/1619] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:26:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:26:19.885419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=6 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:26:23.232470 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=6 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:26:39.212702 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82aa89-43f7-4ad8-a54e-d0a7ba9e01d8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:39.213255 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82aa89-43f7-4ad8-a54e-d0a7ba9e01d8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:39.213464 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82aa89-43f7-4ad8-a54e-d0a7ba9e01d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:39.234196 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9b82aa89-43f7-4ad8-a54e-d0a7ba9e01d8 None None] MFA Rules not processed for user `238ad0efedfd4cd89d99e2abebaeba63`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:39.235425 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9b82aa89-43f7-4ad8-a54e-d0a7ba9e01d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:39.242627 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 815/1620] 10.222.0.107 () {58 vars in 972 bytes} [Tue Aug 23 23:26:39 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:26:39.255767 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef4f90-9f87-4113-81ad-e9e590d0d9dc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:39.268870 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef4f90-9f87-4113-81ad-e9e590d0d9dc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:39.273823 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44a403-b142-4929-89e7-e7db773f01d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d0b95b22bc4117957cbc3afa5547a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:39.274469 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44a403-b142-4929-89e7-e7db773f01d5 service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:39.274745 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44a403-b142-4929-89e7-e7db773f01d5 service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:39.275014 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44a403-b142-4929-89e7-e7db773f01d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:39.284849 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44a403-b142-4929-89e7-e7db773f01d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:39.286455 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44a403-b142-4929-89e7-e7db773f01d5 service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:39.296130 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 806/1621] 10.222.0.107 () {60 vars in 1389 bytes} [Tue Aug 23 23:26:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:26:49.228560 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:26:49.292160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=6 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:26:56.859201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fce16-3d20-4ca7-a68e-a96fe9dc9d07 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:56.859699 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fce16-3d20-4ca7-a68e-a96fe9dc9d07 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:56.859852 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fce16-3d20-4ca7-a68e-a96fe9dc9d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:56.879039 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d89fce16-3d20-4ca7-a68e-a96fe9dc9d07 None None] MFA Rules not processed for user `a7c6e861b3094d85897ce95bc3a868aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:56.880195 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d89fce16-3d20-4ca7-a68e-a96fe9dc9d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:56.886921 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 816/1622] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:26:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:27:06.874036 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:27:13.238423 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44a403-b142-4929-89e7-e7db773f01d5 service swift] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:27:13.248323 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44a403-b142-4929-89e7-e7db773f01d5 service swift] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:27:13.252078 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67aa482-b6c8-422d-9e5c-1b7bdd9b1a17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:27:13.252724 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aa482-b6c8-422d-9e5c-1b7bdd9b1a17 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:13.253005 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aa482-b6c8-422d-9e5c-1b7bdd9b1a17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:13.253275 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aa482-b6c8-422d-9e5c-1b7bdd9b1a17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:13.262179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67aa482-b6c8-422d-9e5c-1b7bdd9b1a17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:27:13.263829 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67aa482-b6c8-422d-9e5c-1b7bdd9b1a17 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:27:13.273636 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 807/1623] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:27:13 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:27:20.230927 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fce16-3d20-4ca7-a68e-a96fe9dc9d07 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:27:20.242665 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fce16-3d20-4ca7-a68e-a96fe9dc9d07 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:27:20.248105 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848aba4-f9ff-4995-be1f-ec9f56f6ef46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ee6ffc0985405193735af49a398326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:27:20.248777 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848aba4-f9ff-4995-be1f-ec9f56f6ef46 service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:20.249059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848aba4-f9ff-4995-be1f-ec9f56f6ef46 service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:20.249327 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848aba4-f9ff-4995-be1f-ec9f56f6ef46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:20.257517 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848aba4-f9ff-4995-be1f-ec9f56f6ef46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:27:20.259092 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848aba4-f9ff-4995-be1f-ec9f56f6ef46 service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:27:20.269306 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 817/1624] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:27:20 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:27:23.269283 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=6 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:27:30.265415 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=6 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:28:30.916663 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b3047-f1d0-457e-9d51-a70e51d08516 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:30.917141 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b3047-f1d0-457e-9d51-a70e51d08516 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:30.917256 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b3047-f1d0-457e-9d51-a70e51d08516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:30.940957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-cb4b3047-f1d0-457e-9d51-a70e51d08516 None None] MFA Rules not processed for user `238ad0efedfd4cd89d99e2abebaeba63`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:28:30.942200 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cb4b3047-f1d0-457e-9d51-a70e51d08516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:30.949726 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 808/1625] 10.222.0.107 () {58 vars in 972 bytes} [Tue Aug 23 23:28:30 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:28:31.003168 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848aba4-f9ff-4995-be1f-ec9f56f6ef46 service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:28:31.014753 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848aba4-f9ff-4995-be1f-ec9f56f6ef46 service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:28:31.019753 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f84c1-a6e6-4e24-b064-beb48751f7c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d0b95b22bc4117957cbc3afa5547a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:28:31.020346 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f84c1-a6e6-4e24-b064-beb48751f7c9 service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:31.020656 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f84c1-a6e6-4e24-b064-beb48751f7c9 service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:31.020931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f84c1-a6e6-4e24-b064-beb48751f7c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:31.028730 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f84c1-a6e6-4e24-b064-beb48751f7c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:28:31.030424 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f84c1-a6e6-4e24-b064-beb48751f7c9 service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:28:31.038269 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 818/1626] 10.222.0.107 () {60 vars in 1389 bytes} [Tue Aug 23 23:28:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:28:31.505369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d158e-4734-4f10-8faf-9dabc4450e39 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:31.505652 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d158e-4734-4f10-8faf-9dabc4450e39 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:31.505925 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d158e-4734-4f10-8faf-9dabc4450e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:31.525572 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2f9d158e-4734-4f10-8faf-9dabc4450e39 None None] MFA Rules not processed for user `238ad0efedfd4cd89d99e2abebaeba63`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:28:31.526786 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2f9d158e-4734-4f10-8faf-9dabc4450e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:31.534153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 809/1627] 10.222.0.107 () {58 vars in 1014 bytes} [Tue Aug 23 23:28:31 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:28:31.546683 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f84c1-a6e6-4e24-b064-beb48751f7c9 service swift] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:28:31.557043 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f84c1-a6e6-4e24-b064-beb48751f7c9 service swift] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:28:31.563543 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e41528-aaa8-4bcf-8986-0ab3a02b85b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d0b95b22bc4117957cbc3afa5547a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:28:31.564149 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e41528-aaa8-4bcf-8986-0ab3a02b85b2 service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:31.564427 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e41528-aaa8-4bcf-8986-0ab3a02b85b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:31.564728 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e41528-aaa8-4bcf-8986-0ab3a02b85b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:31.574841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e41528-aaa8-4bcf-8986-0ab3a02b85b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:28:31.576450 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e41528-aaa8-4bcf-8986-0ab3a02b85b2 service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:28:31.585333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 819/1628] 10.222.0.107 () {60 vars in 1389 bytes} [Tue Aug 23 23:28:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:28:39.839007 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00979d5c-bfca-4820-8fee-1237cdcbe511 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:39.839553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00979d5c-bfca-4820-8fee-1237cdcbe511 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:39.839553 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00979d5c-bfca-4820-8fee-1237cdcbe511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:39.859355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-00979d5c-bfca-4820-8fee-1237cdcbe511 None None] MFA Rules not processed for user `04d040da00ab4244896122cd0b958801`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:28:39.860575 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-00979d5c-bfca-4820-8fee-1237cdcbe511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:39.867536 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 810/1629] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:28:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:28:41.582010 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=12 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:28:41.642934 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f779a7-3343-48fe-abc3-7c29739fa7cd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:41.643216 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f779a7-3343-48fe-abc3-7c29739fa7cd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:41.643494 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f779a7-3343-48fe-abc3-7c29739fa7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:41.662200 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a4f779a7-3343-48fe-abc3-7c29739fa7cd None None] MFA Rules not processed for user `238ad0efedfd4cd89d99e2abebaeba63`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:28:41.663407 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a4f779a7-3343-48fe-abc3-7c29739fa7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:28:41.671384 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 820/1630] 10.222.0.107 () {58 vars in 1014 bytes} [Tue Aug 23 23:28:41 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:28:41.683906 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00979d5c-bfca-4820-8fee-1237cdcbe511 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:28:41.696336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00979d5c-bfca-4820-8fee-1237cdcbe511 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:28:41.701258 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf449c5-0ce8-4362-a43f-dc9561fe3eb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d0b95b22bc4117957cbc3afa5547a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:28:41.701894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf449c5-0ce8-4362-a43f-dc9561fe3eb2 service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:28:41.702172 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf449c5-0ce8-4362-a43f-dc9561fe3eb2 service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:28:41.702445 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf449c5-0ce8-4362-a43f-dc9561fe3eb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:28:41.710721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf449c5-0ce8-4362-a43f-dc9561fe3eb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:28:41.712308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf449c5-0ce8-4362-a43f-dc9561fe3eb2 service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:28:41.720452 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 811/1631] 10.222.0.107 () {60 vars in 1389 bytes} [Tue Aug 23 23:28:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:28:51.657142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:28:51.717708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=15 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:29:07.069836 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f779a7-3343-48fe-abc3-7c29739fa7cd None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:07.121510 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f779a7-3343-48fe-abc3-7c29739fa7cd None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:07.125951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283c101-e4bf-4b02-804c-dfaf606390dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8937ae9f5c7840a2a5af5f851d02ea77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:07.126549 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283c101-e4bf-4b02-804c-dfaf606390dd service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:07.126822 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283c101-e4bf-4b02-804c-dfaf606390dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:07.127091 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283c101-e4bf-4b02-804c-dfaf606390dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:07.135136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283c101-e4bf-4b02-804c-dfaf606390dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:07.136535 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283c101-e4bf-4b02-804c-dfaf606390dd service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:07.145060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 821/1632] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:29:07 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:29:17.141340 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=26 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:29:20.261764 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf449c5-0ce8-4362-a43f-dc9561fe3eb2 service swift] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:20.274251 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf449c5-0ce8-4362-a43f-dc9561fe3eb2 service swift] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:20.279904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37569cf3-fab0-4134-90d7-2bd3ec63e143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:20.281042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37569cf3-fab0-4134-90d7-2bd3ec63e143 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:20.281333 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37569cf3-fab0-4134-90d7-2bd3ec63e143 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:20.281679 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37569cf3-fab0-4134-90d7-2bd3ec63e143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:20.289460 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37569cf3-fab0-4134-90d7-2bd3ec63e143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:20.291020 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37569cf3-fab0-4134-90d7-2bd3ec63e143 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:20.301457 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 812/1633] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:29:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:29:20.486606 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283c101-e4bf-4b02-804c-dfaf606390dd service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:20.495970 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283c101-e4bf-4b02-804c-dfaf606390dd service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:20.499554 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82ffa2-abef-4817-a9a6-37471ae66269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:20.500150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82ffa2-abef-4817-a9a6-37471ae66269 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:20.500447 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82ffa2-abef-4817-a9a6-37471ae66269 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:20.500853 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82ffa2-abef-4817-a9a6-37471ae66269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:20.510816 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82ffa2-abef-4817-a9a6-37471ae66269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:20.512171 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82ffa2-abef-4817-a9a6-37471ae66269 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:20.523317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 822/1634] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:29:20 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:29:21.712891 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37569cf3-fab0-4134-90d7-2bd3ec63e143 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:21.722459 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37569cf3-fab0-4134-90d7-2bd3ec63e143 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:21.725969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e03da-73d2-4cd5-b343-dfbd1256a30b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:21.726567 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e03da-73d2-4cd5-b343-dfbd1256a30b service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:21.726847 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e03da-73d2-4cd5-b343-dfbd1256a30b service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:21.727116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e03da-73d2-4cd5-b343-dfbd1256a30b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:21.738074 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e03da-73d2-4cd5-b343-dfbd1256a30b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:21.739505 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e03da-73d2-4cd5-b343-dfbd1256a30b service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:21.750137 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 813/1635] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:29:21 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:29:25.217347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d239b-2811-4bb4-a573-abc385d5a34b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:25.217858 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d239b-2811-4bb4-a573-abc385d5a34b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:25.218664 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d239b-2811-4bb4-a573-abc385d5a34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:25.237550 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cf2d239b-2811-4bb4-a573-abc385d5a34b None None] MFA Rules not processed for user `a7c6e861b3094d85897ce95bc3a868aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:29:25.238566 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cf2d239b-2811-4bb4-a573-abc385d5a34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:25.245841 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 823/1636] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:29:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:29:25.567710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e03da-73d2-4cd5-b343-dfbd1256a30b service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:25.576118 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e03da-73d2-4cd5-b343-dfbd1256a30b service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:25.580874 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cfef9-bce5-4650-a0be-f899f1ca5ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:25.581471 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cfef9-bce5-4650-a0be-f899f1ca5ccb service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:25.581747 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cfef9-bce5-4650-a0be-f899f1ca5ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:25.582017 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cfef9-bce5-4650-a0be-f899f1ca5ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:25.588977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cfef9-bce5-4650-a0be-f899f1ca5ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:25.590400 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cfef9-bce5-4650-a0be-f899f1ca5ccb service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:25.598368 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 814/1637] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:29:25 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:29:26.049246 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d239b-2811-4bb4-a573-abc385d5a34b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:26.061212 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d239b-2811-4bb4-a573-abc385d5a34b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:26.067226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd821fb-fea8-461b-90bd-06da0e3fdc35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ee6ffc0985405193735af49a398326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:26.068215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd821fb-fea8-461b-90bd-06da0e3fdc35 service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:26.068500 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd821fb-fea8-461b-90bd-06da0e3fdc35 service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:26.068833 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd821fb-fea8-461b-90bd-06da0e3fdc35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:26.078124 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd821fb-fea8-461b-90bd-06da0e3fdc35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:26.080069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd821fb-fea8-461b-90bd-06da0e3fdc35 service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:26.090336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 824/1638] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:29:26 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:29:35.595121 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=18 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:29:36.086015 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=15 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:29:37.764583 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cfef9-bce5-4650-a0be-f899f1ca5ccb service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:37.773353 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cfef9-bce5-4650-a0be-f899f1ca5ccb service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:37.777067 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781213b-374c-4615-a886-86e941090330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:37.777569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781213b-374c-4615-a886-86e941090330 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:37.777844 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781213b-374c-4615-a886-86e941090330 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:37.778112 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781213b-374c-4615-a886-86e941090330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:37.785201 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781213b-374c-4615-a886-86e941090330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:37.786937 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781213b-374c-4615-a886-86e941090330 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:37.794519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 815/1639] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:29:37 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:29:47.791044 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=6 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:30:35.568215 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd821fb-fea8-461b-90bd-06da0e3fdc35 service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:35.585905 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd821fb-fea8-461b-90bd-06da0e3fdc35 service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:35.592199 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4575e-04c5-400a-8b0e-41a52c5e9483 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:35.592925 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4575e-04c5-400a-8b0e-41a52c5e9483 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:35.593450 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4575e-04c5-400a-8b0e-41a52c5e9483 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:35.593788 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4575e-04c5-400a-8b0e-41a52c5e9483 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:35.609000 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4575e-04c5-400a-8b0e-41a52c5e9483 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:35.610708 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4575e-04c5-400a-8b0e-41a52c5e9483 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:35.624871 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 825/1640] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:30:35 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:30:37.177799 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781213b-374c-4615-a886-86e941090330 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:37.191778 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781213b-374c-4615-a886-86e941090330 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:37.197899 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a514ebd-0c1a-4f46-88cb-ac7e8bd0d691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:37.198662 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a514ebd-0c1a-4f46-88cb-ac7e8bd0d691 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:37.199035 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a514ebd-0c1a-4f46-88cb-ac7e8bd0d691 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:37.199520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a514ebd-0c1a-4f46-88cb-ac7e8bd0d691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:37.213454 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a514ebd-0c1a-4f46-88cb-ac7e8bd0d691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:37.215274 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a514ebd-0c1a-4f46-88cb-ac7e8bd0d691 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:37.227887 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 816/1641] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:30:37 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:30:43.534607 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32c60a-f1e2-4a44-a8ec-926bdffa68fb None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:43.535070 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32c60a-f1e2-4a44-a8ec-926bdffa68fb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:43.535709 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32c60a-f1e2-4a44-a8ec-926bdffa68fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:43.556308 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8b32c60a-f1e2-4a44-a8ec-926bdffa68fb None None] MFA Rules not processed for user `238ad0efedfd4cd89d99e2abebaeba63`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:43.557573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8b32c60a-f1e2-4a44-a8ec-926bdffa68fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:43.564880 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 826/1642] 10.222.0.107 () {58 vars in 972 bytes} [Tue Aug 23 23:30:43 2022] POST /identity/v3/auth/tokens => generated 3205 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:30:43.608042 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a514ebd-0c1a-4f46-88cb-ac7e8bd0d691 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:43.619631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a514ebd-0c1a-4f46-88cb-ac7e8bd0d691 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:43.624715 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d8a47-dad2-4bd2-846f-5c6c3f2a7ebf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d0b95b22bc4117957cbc3afa5547a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:43.625307 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d8a47-dad2-4bd2-846f-5c6c3f2a7ebf service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:43.625589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d8a47-dad2-4bd2-846f-5c6c3f2a7ebf service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:43.625858 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d8a47-dad2-4bd2-846f-5c6c3f2a7ebf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:43.634262 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d8a47-dad2-4bd2-846f-5c6c3f2a7ebf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:43.635824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d8a47-dad2-4bd2-846f-5c6c3f2a7ebf service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:43.645999 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 817/1643] 10.222.0.107 () {60 vars in 1389 bytes} [Tue Aug 23 23:30:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:30:44.009728 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32c60a-f1e2-4a44-a8ec-926bdffa68fb None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:44.019520 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32c60a-f1e2-4a44-a8ec-926bdffa68fb None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:44.023070 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810c916-b337-4539-a31b-89988aaefc99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:44.023671 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810c916-b337-4539-a31b-89988aaefc99 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:44.023952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810c916-b337-4539-a31b-89988aaefc99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:44.024226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810c916-b337-4539-a31b-89988aaefc99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:44.087356 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810c916-b337-4539-a31b-89988aaefc99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:44.088843 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810c916-b337-4539-a31b-89988aaefc99 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:44.098408 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 827/1644] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:30:44 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:30:47.460667 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93ef8c-1789-46d1-b796-19df819ba33b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:47.461151 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93ef8c-1789-46d1-b796-19df819ba33b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:47.461421 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93ef8c-1789-46d1-b796-19df819ba33b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:47.462869 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 818/1645] 10.222.0.107 () {54 vars in 926 bytes} [Tue Aug 23 23:30:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:30:47.472116 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e584ae0-40a6-462a-9d9c-aaba1918824a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:47.472565 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e584ae0-40a6-462a-9d9c-aaba1918824a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:47.472721 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e584ae0-40a6-462a-9d9c-aaba1918824a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:47.493564 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7e584ae0-40a6-462a-9d9c-aaba1918824a None None] MFA Rules not processed for user `14ee6ffc0985405193735af49a398326`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:47.494784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7e584ae0-40a6-462a-9d9c-aaba1918824a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:47.504718 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 828/1646] 10.222.0.107 () {58 vars in 1023 bytes} [Tue Aug 23 23:30:47 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:30:47.528777 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93ef8c-1789-46d1-b796-19df819ba33b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:47.550394 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93ef8c-1789-46d1-b796-19df819ba33b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:47.555487 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb5410-3c89-4075-96fa-1b929110275f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ee6ffc0985405193735af49a398326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:47.556136 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb5410-3c89-4075-96fa-1b929110275f service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:47.556630 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb5410-3c89-4075-96fa-1b929110275f service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:47.556904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb5410-3c89-4075-96fa-1b929110275f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:47.570741 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb5410-3c89-4075-96fa-1b929110275f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:47.572339 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb5410-3c89-4075-96fa-1b929110275f service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:47.583643 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 819/1647] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:30:47 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:30:50.776985 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5f89d-0bfc-4e1b-bb9c-c1e418287268 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:50.777507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5f89d-0bfc-4e1b-bb9c-c1e418287268 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:50.777507 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5f89d-0bfc-4e1b-bb9c-c1e418287268 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:50.779001 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 829/1648] 10.222.0.107 () {54 vars in 926 bytes} [Tue Aug 23 23:30:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 23 23:30:50.796895 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cb318-e73e-498b-89a2-9fe26b21aa6a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:50.797369 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cb318-e73e-498b-89a2-9fe26b21aa6a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:50.797651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cb318-e73e-498b-89a2-9fe26b21aa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:50.823107 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e92cb318-e73e-498b-89a2-9fe26b21aa6a None None] MFA Rules not processed for user `14ee6ffc0985405193735af49a398326`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:30:50.824419 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e92cb318-e73e-498b-89a2-9fe26b21aa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:50.833565 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 820/1649] 10.222.0.107 () {58 vars in 1023 bytes} [Tue Aug 23 23:30:50 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:30:50.855167 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5f89d-0bfc-4e1b-bb9c-c1e418287268 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:50.874181 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cb318-e73e-498b-89a2-9fe26b21aa6a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:50.874951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5f89d-0bfc-4e1b-bb9c-c1e418287268 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:50.880676 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917dda8-5010-4c8e-b347-35294d9c32e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ee6ffc0985405193735af49a398326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:50.881492 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917dda8-5010-4c8e-b347-35294d9c32e1 service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:50.881771 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917dda8-5010-4c8e-b347-35294d9c32e1 service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:50.882252 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917dda8-5010-4c8e-b347-35294d9c32e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:50.886417 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cb318-e73e-498b-89a2-9fe26b21aa6a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:50.891268 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68178c9b-a4e3-49f9-a075-99a7c7d20c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:50.891837 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68178c9b-a4e3-49f9-a075-99a7c7d20c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:50.892115 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68178c9b-a4e3-49f9-a075-99a7c7d20c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:50.892367 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917dda8-5010-4c8e-b347-35294d9c32e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:50.892461 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68178c9b-a4e3-49f9-a075-99a7c7d20c45 admin admin] PATH_INFO: `/v3/users/04d040da00ab4244896122cd0b958801` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:50.894257 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68178c9b-a4e3-49f9-a075-99a7c7d20c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04d040da00ab4244896122cd0b958801)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:50.894573 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917dda8-5010-4c8e-b347-35294d9c32e1 service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:50.895317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: WARNING py.warnings [None req-68178c9b-a4e3-49f9-a075-99a7c7d20c45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:30:50.895317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: warnings.warn(msg) Aug 23 23:30:50.895317 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: Aug 23 23:30:50.896519 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68178c9b-a4e3-49f9-a075-99a7c7d20c45 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:50.905577 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 830/1650] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:30:50 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:30:50.968249 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-68178c9b-a4e3-49f9-a075-99a7c7d20c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04d040da00ab4244896122cd0b958801'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:50.987106 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-68178c9b-a4e3-49f9-a075-99a7c7d20c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04d040da00ab4244896122cd0b958801'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:50.997447 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-68178c9b-a4e3-49f9-a075-99a7c7d20c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04d040da00ab4244896122cd0b958801'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:51.004954 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-68178c9b-a4e3-49f9-a075-99a7c7d20c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04d040da00ab4244896122cd0b958801'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:51.005710 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-68178c9b-a4e3-49f9-a075-99a7c7d20c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04d040da00ab4244896122cd0b958801'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:51.012904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 821/1651] 10.222.0.107 () {58 vars in 1229 bytes} [Tue Aug 23 23:30:50 2022] DELETE /identity/v3/users/04d040da00ab4244896122cd0b958801 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:30:51.208384 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917dda8-5010-4c8e-b347-35294d9c32e1 service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:51.218943 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917dda8-5010-4c8e-b347-35294d9c32e1 service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:51.277060 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d43f81-489c-45a7-af53-127d2de533be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:51.277703 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d43f81-489c-45a7-af53-127d2de533be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:51.277980 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d43f81-489c-45a7-af53-127d2de533be admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:51.278247 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d43f81-489c-45a7-af53-127d2de533be admin admin] PATH_INFO: `/v3/projects/9d55c2c8a7cc4890a9e4266fe003b99f` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:51.279349 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d43f81-489c-45a7-af53-127d2de533be admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d55c2c8a7cc4890a9e4266fe003b99f)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:51.280393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: WARNING py.warnings [None req-a2d43f81-489c-45a7-af53-127d2de533be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:30:51.280393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: warnings.warn(msg) Aug 23 23:30:51.280393 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: Aug 23 23:30:51.281651 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d43f81-489c-45a7-af53-127d2de533be admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:51.337428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a2d43f81-489c-45a7-af53-127d2de533be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d55c2c8a7cc4890a9e4266fe003b99f', 'request_id': 'req-a2d43f81-489c-45a7-af53-127d2de533be'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:51.345211 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a2d43f81-489c-45a7-af53-127d2de533be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d55c2c8a7cc4890a9e4266fe003b99f', 'request_id': 'req-a2d43f81-489c-45a7-af53-127d2de533be'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:51.346565 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:30:51.361292 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a2d43f81-489c-45a7-af53-127d2de533be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d55c2c8a7cc4890a9e4266fe003b99f', 'request_id': 'req-a2d43f81-489c-45a7-af53-127d2de533be'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:51.372894 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a2d43f81-489c-45a7-af53-127d2de533be admin admin] The token cache is being invalidate because project 9d55c2c8a7cc4890a9e4266fe003b99f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:30:51.373284 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a2d43f81-489c-45a7-af53-127d2de533be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:51.373951 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a2d43f81-489c-45a7-af53-127d2de533be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:51.375719 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 831/1652] 10.222.0.107 () {58 vars in 1238 bytes} [Tue Aug 23 23:30:51 2022] DELETE /identity/v3/projects/9d55c2c8a7cc4890a9e4266fe003b99f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:30:51.380050 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68178c9b-a4e3-49f9-a075-99a7c7d20c45 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:51.381585 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-68178c9b-a4e3-49f9-a075-99a7c7d20c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:51.396214 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68178c9b-a4e3-49f9-a075-99a7c7d20c45 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:51.458341 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443732fc-a75c-4d65-b772-27f2077c8055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:51.458984 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443732fc-a75c-4d65-b772-27f2077c8055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:51.459261 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443732fc-a75c-4d65-b772-27f2077c8055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:51.459563 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443732fc-a75c-4d65-b772-27f2077c8055 admin admin] PATH_INFO: `/v3/users/1574635b7d8141989a7906515cbc0fe5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:51.460765 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443732fc-a75c-4d65-b772-27f2077c8055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1574635b7d8141989a7906515cbc0fe5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:51.462825 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443732fc-a75c-4d65-b772-27f2077c8055 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:51.491045 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:30:51.511508 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-443732fc-a75c-4d65-b772-27f2077c8055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1574635b7d8141989a7906515cbc0fe5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:51.523552 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-443732fc-a75c-4d65-b772-27f2077c8055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1574635b7d8141989a7906515cbc0fe5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:51.530206 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-443732fc-a75c-4d65-b772-27f2077c8055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1574635b7d8141989a7906515cbc0fe5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:51.537435 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-443732fc-a75c-4d65-b772-27f2077c8055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1574635b7d8141989a7906515cbc0fe5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:51.538103 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-443732fc-a75c-4d65-b772-27f2077c8055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1574635b7d8141989a7906515cbc0fe5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:51.544142 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 822/1653] 10.222.0.107 () {58 vars in 1229 bytes} [Tue Aug 23 23:30:51 2022] DELETE /identity/v3/users/1574635b7d8141989a7906515cbc0fe5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:30:51.718170 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d43f81-489c-45a7-af53-127d2de533be admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:30:51.719625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a2d43f81-489c-45a7-af53-127d2de533be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:30:51.734035 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d43f81-489c-45a7-af53-127d2de533be admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:30:51.790642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c52173-c61a-41ee-8227-eca871771f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:30:51.791433 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c52173-c61a-41ee-8227-eca871771f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:30:51.791528 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c52173-c61a-41ee-8227-eca871771f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:30:51.791777 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c52173-c61a-41ee-8227-eca871771f4b admin admin] PATH_INFO: `/v3/projects/c14872a12d054275ae316c504eab07a8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:30:51.792913 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c52173-c61a-41ee-8227-eca871771f4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c14872a12d054275ae316c504eab07a8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:30:51.795063 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c52173-c61a-41ee-8227-eca871771f4b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:30:51.840362 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-74c52173-c61a-41ee-8227-eca871771f4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c14872a12d054275ae316c504eab07a8', 'request_id': 'req-74c52173-c61a-41ee-8227-eca871771f4b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:51.847872 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-74c52173-c61a-41ee-8227-eca871771f4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c14872a12d054275ae316c504eab07a8', 'request_id': 'req-74c52173-c61a-41ee-8227-eca871771f4b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:51.854311 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-74c52173-c61a-41ee-8227-eca871771f4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c14872a12d054275ae316c504eab07a8', 'request_id': 'req-74c52173-c61a-41ee-8227-eca871771f4b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:51.866437 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-74c52173-c61a-41ee-8227-eca871771f4b admin admin] The token cache is being invalidate because project c14872a12d054275ae316c504eab07a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:30:51.866737 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-74c52173-c61a-41ee-8227-eca871771f4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:51.867422 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-74c52173-c61a-41ee-8227-eca871771f4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:30:51.868969 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 832/1654] 10.222.0.107 () {58 vars in 1238 bytes} [Tue Aug 23 23:30:51 2022] DELETE /identity/v3/projects/c14872a12d054275ae316c504eab07a8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:31:01.540518 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=19,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:31:01.862202 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=56,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:31:31.694625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d0ed3-47a3-43ba-820b-838bb23d2470 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:31.695128 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d0ed3-47a3-43ba-820b-838bb23d2470 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:31.695225 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d0ed3-47a3-43ba-820b-838bb23d2470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:31.714476 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-af9d0ed3-47a3-43ba-820b-838bb23d2470 None None] MFA Rules not processed for user `a7c6e861b3094d85897ce95bc3a868aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:31:31.715669 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-af9d0ed3-47a3-43ba-820b-838bb23d2470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:31.772097 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 823/1655] 10.222.0.107 () {58 vars in 963 bytes} [Tue Aug 23 23:31:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:31:32.096948 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c52173-c61a-41ee-8227-eca871771f4b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:32.098480 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-74c52173-c61a-41ee-8227-eca871771f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:32.153415 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c52173-c61a-41ee-8227-eca871771f4b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:32.157129 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fb112-e856-4938-81d4-9a25b8c4a7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:32.157741 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fb112-e856-4938-81d4-9a25b8c4a7af service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:32.158020 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fb112-e856-4938-81d4-9a25b8c4a7af service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:32.158297 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fb112-e856-4938-81d4-9a25b8c4a7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:32.160150 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b75fb112-e856-4938-81d4-9a25b8c4a7af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:32.169397 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fb112-e856-4938-81d4-9a25b8c4a7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:32.171113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fb112-e856-4938-81d4-9a25b8c4a7af service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:32.179783 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 833/1656] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:31:32 2022] GET /identity/v3/auth/tokens => generated 3131 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:31:41.764668 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=25 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:31:42.175516 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=26 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:31:50.175581 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d0ed3-47a3-43ba-820b-838bb23d2470 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:31:50.177437 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-af9d0ed3-47a3-43ba-820b-838bb23d2470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:50.258345 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d0ed3-47a3-43ba-820b-838bb23d2470 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:31:50.263957 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a442293-d671-4beb-963e-e9b9d885c46c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f985626d8af4f3089e72998fad98b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:31:50.264578 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a442293-d671-4beb-963e-e9b9d885c46c service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:31:50.264882 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a442293-d671-4beb-963e-e9b9d885c46c service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:31:50.265153 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a442293-d671-4beb-963e-e9b9d885c46c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:31:50.266952 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3a442293-d671-4beb-963e-e9b9d885c46c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:31:50.280163 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a442293-d671-4beb-963e-e9b9d885c46c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:31:50.281904 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a442293-d671-4beb-963e-e9b9d885c46c service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:31:50.293295 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 824/1657] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:31:50 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:32:00.288699 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=34 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:32:28.790690 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fb112-e856-4938-81d4-9a25b8c4a7af service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:32:28.792108 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b75fb112-e856-4938-81d4-9a25b8c4a7af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:32:28.933741 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fb112-e856-4938-81d4-9a25b8c4a7af service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:32:28.938784 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c300d-77cf-4d99-be8f-3c3a13485723 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ee6ffc0985405193735af49a398326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:32:28.939394 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c300d-77cf-4d99-be8f-3c3a13485723 service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:32:28.939674 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c300d-77cf-4d99-be8f-3c3a13485723 service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:32:28.939948 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c300d-77cf-4d99-be8f-3c3a13485723 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:32:28.941779 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fc4c300d-77cf-4d99-be8f-3c3a13485723 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:32:28.952753 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c300d-77cf-4d99-be8f-3c3a13485723 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:32:28.954324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c300d-77cf-4d99-be8f-3c3a13485723 service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:32:28.964329 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 834/1658] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:32:28 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:32:38.960113 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=63 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:33:36.425075 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a442293-d671-4beb-963e-e9b9d885c46c service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:33:36.463440 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a442293-d671-4beb-963e-e9b9d885c46c service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:33:36.467069 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7c3b1-481f-4886-872b-2bd2e68f3bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88d0d18ad66438191541b84fc1431bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:33:36.467658 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7c3b1-481f-4886-872b-2bd2e68f3bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:33:36.467931 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7c3b1-481f-4886-872b-2bd2e68f3bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:33:36.468200 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7c3b1-481f-4886-872b-2bd2e68f3bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:33:36.469939 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-32d7c3b1-481f-4886-872b-2bd2e68f3bc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:33:36.552495 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7c3b1-481f-4886-872b-2bd2e68f3bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:33:36.553970 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7c3b1-481f-4886-872b-2bd2e68f3bc7 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:33:36.574244 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 825/1659] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:33:36 2022] GET /identity/v3/auth/tokens => generated 3249 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:33:42.777463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c300d-77cf-4d99-be8f-3c3a13485723 service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:33:42.780122 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fc4c300d-77cf-4d99-be8f-3c3a13485723 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:33:42.800902 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c300d-77cf-4d99-be8f-3c3a13485723 service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:33:42.807959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecd2d9-d226-46a1-b7ad-e105ad21c584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:33:42.808552 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecd2d9-d226-46a1-b7ad-e105ad21c584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:33:42.808885 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecd2d9-d226-46a1-b7ad-e105ad21c584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:33:42.809160 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecd2d9-d226-46a1-b7ad-e105ad21c584 admin admin] PATH_INFO: `/v3/users/a7c6e861b3094d85897ce95bc3a868aa` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:33:42.810321 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecd2d9-d226-46a1-b7ad-e105ad21c584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7c6e861b3094d85897ce95bc3a868aa)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:33:42.812324 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecd2d9-d226-46a1-b7ad-e105ad21c584 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:33:42.871815 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bdecd2d9-d226-46a1-b7ad-e105ad21c584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7c6e861b3094d85897ce95bc3a868aa'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:42.879686 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bdecd2d9-d226-46a1-b7ad-e105ad21c584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7c6e861b3094d85897ce95bc3a868aa'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:42.896011 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bdecd2d9-d226-46a1-b7ad-e105ad21c584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7c6e861b3094d85897ce95bc3a868aa'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:42.907642 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bdecd2d9-d226-46a1-b7ad-e105ad21c584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7c6e861b3094d85897ce95bc3a868aa'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:42.908286 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-bdecd2d9-d226-46a1-b7ad-e105ad21c584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7c6e861b3094d85897ce95bc3a868aa'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:42.915304 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 835/1660] 10.222.0.107 () {58 vars in 1229 bytes} [Tue Aug 23 23:33:42 2022] DELETE /identity/v3/users/a7c6e861b3094d85897ce95bc3a868aa => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:33:43.093447 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7c3b1-481f-4886-872b-2bd2e68f3bc7 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:33:43.103311 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7c3b1-481f-4886-872b-2bd2e68f3bc7 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:33:43.160205 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751b2f3-510f-4a77-a733-eeec64dbc52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:33:43.160802 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751b2f3-510f-4a77-a733-eeec64dbc52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:33:43.161080 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751b2f3-510f-4a77-a733-eeec64dbc52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:33:43.161377 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751b2f3-510f-4a77-a733-eeec64dbc52f admin admin] PATH_INFO: `/v3/projects/f121206e3cb14707b3a4b54bc30c5934` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:33:43.162482 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751b2f3-510f-4a77-a733-eeec64dbc52f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f121206e3cb14707b3a4b54bc30c5934)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:33:43.164775 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751b2f3-510f-4a77-a733-eeec64dbc52f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:33:43.205832 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:33:43.212876 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7751b2f3-510f-4a77-a733-eeec64dbc52f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f121206e3cb14707b3a4b54bc30c5934', 'request_id': 'req-7751b2f3-510f-4a77-a733-eeec64dbc52f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:43.219945 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7751b2f3-510f-4a77-a733-eeec64dbc52f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f121206e3cb14707b3a4b54bc30c5934', 'request_id': 'req-7751b2f3-510f-4a77-a733-eeec64dbc52f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:43.226109 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7751b2f3-510f-4a77-a733-eeec64dbc52f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f121206e3cb14707b3a4b54bc30c5934', 'request_id': 'req-7751b2f3-510f-4a77-a733-eeec64dbc52f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:43.236413 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7751b2f3-510f-4a77-a733-eeec64dbc52f admin admin] The token cache is being invalidate because project f121206e3cb14707b3a4b54bc30c5934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:33:43.236824 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7751b2f3-510f-4a77-a733-eeec64dbc52f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:43.237463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7751b2f3-510f-4a77-a733-eeec64dbc52f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:43.238977 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 826/1661] 10.222.0.107 () {58 vars in 1238 bytes} [Tue Aug 23 23:33:43 2022] DELETE /identity/v3/projects/f121206e3cb14707b3a4b54bc30c5934 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:33:43.243673 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecd2d9-d226-46a1-b7ad-e105ad21c584 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:33:43.245233 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bdecd2d9-d226-46a1-b7ad-e105ad21c584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:33:43.260355 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecd2d9-d226-46a1-b7ad-e105ad21c584 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:33:43.315959 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8318c-620f-45d9-bb5c-665073cc2bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:33:43.316589 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8318c-620f-45d9-bb5c-665073cc2bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:33:43.316896 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8318c-620f-45d9-bb5c-665073cc2bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:33:43.317165 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8318c-620f-45d9-bb5c-665073cc2bd8 admin admin] PATH_INFO: `/v3/users/b903b0c5595347c3ae6f137f6417c5de` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:33:43.318309 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8318c-620f-45d9-bb5c-665073cc2bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b903b0c5595347c3ae6f137f6417c5de)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:33:43.320982 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8318c-620f-45d9-bb5c-665073cc2bd8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:33:43.365159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-09e8318c-620f-45d9-bb5c-665073cc2bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b903b0c5595347c3ae6f137f6417c5de'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:43.372428 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-09e8318c-620f-45d9-bb5c-665073cc2bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b903b0c5595347c3ae6f137f6417c5de'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:43.385631 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-09e8318c-620f-45d9-bb5c-665073cc2bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b903b0c5595347c3ae6f137f6417c5de'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:43.387424 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:33:43.393625 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-09e8318c-620f-45d9-bb5c-665073cc2bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b903b0c5595347c3ae6f137f6417c5de'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:43.394347 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-09e8318c-620f-45d9-bb5c-665073cc2bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b903b0c5595347c3ae6f137f6417c5de'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:43.401159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 836/1662] 10.222.0.107 () {58 vars in 1229 bytes} [Tue Aug 23 23:33:43 2022] DELETE /identity/v3/users/b903b0c5595347c3ae6f137f6417c5de => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:33:43.574598 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751b2f3-510f-4a77-a733-eeec64dbc52f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:33:43.576059 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7751b2f3-510f-4a77-a733-eeec64dbc52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:33:43.590701 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751b2f3-510f-4a77-a733-eeec64dbc52f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:33:43.648476 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6252d1-b7d0-424d-ba5e-e3addaa2a242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dbee4330ce74aedb00eece717c969c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ab98da0af85419a9eb4e9e222c7d0ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:33:43.649046 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6252d1-b7d0-424d-ba5e-e3addaa2a242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:33:43.649327 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6252d1-b7d0-424d-ba5e-e3addaa2a242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:33:43.649601 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6252d1-b7d0-424d-ba5e-e3addaa2a242 admin admin] PATH_INFO: `/v3/projects/fc0c25ea610d46be8b57bbd9bf2071f6` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:33:43.650716 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6252d1-b7d0-424d-ba5e-e3addaa2a242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc0c25ea610d46be8b57bbd9bf2071f6)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:33:43.652691 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6252d1-b7d0-424d-ba5e-e3addaa2a242 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:33:43.699159 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3a6252d1-b7d0-424d-ba5e-e3addaa2a242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc0c25ea610d46be8b57bbd9bf2071f6', 'request_id': 'req-3a6252d1-b7d0-424d-ba5e-e3addaa2a242'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:43.706336 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3a6252d1-b7d0-424d-ba5e-e3addaa2a242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc0c25ea610d46be8b57bbd9bf2071f6', 'request_id': 'req-3a6252d1-b7d0-424d-ba5e-e3addaa2a242'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:43.712546 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3a6252d1-b7d0-424d-ba5e-e3addaa2a242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc0c25ea610d46be8b57bbd9bf2071f6', 'request_id': 'req-3a6252d1-b7d0-424d-ba5e-e3addaa2a242'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:43.722938 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3a6252d1-b7d0-424d-ba5e-e3addaa2a242 admin admin] The token cache is being invalidate because project fc0c25ea610d46be8b57bbd9bf2071f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:33:43.723226 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3a6252d1-b7d0-424d-ba5e-e3addaa2a242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:43.723861 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3a6252d1-b7d0-424d-ba5e-e3addaa2a242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:33:43.725405 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 827/1663] 10.222.0.107 () {58 vars in 1238 bytes} [Tue Aug 23 23:33:43 2022] DELETE /identity/v3/projects/fc0c25ea610d46be8b57bbd9bf2071f6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:33:53.397620 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:33:53.719940 dv-osbrick-853458-3-iscsi devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=60,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:37:31.112678 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8318c-620f-45d9-bb5c-665073cc2bd8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:37:31.114077 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-09e8318c-620f-45d9-bb5c-665073cc2bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:37:31.183458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8318c-620f-45d9-bb5c-665073cc2bd8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:37:31.242569 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eaa569-d2bd-436e-ab9d-a08c2a1cc18e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ee6ffc0985405193735af49a398326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7cdd07c79614516be35aa2d82ec6a3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:37:31.243179 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaa569-d2bd-436e-ab9d-a08c2a1cc18e service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:37:31.243458 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaa569-d2bd-436e-ab9d-a08c2a1cc18e service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:37:31.243733 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaa569-d2bd-436e-ab9d-a08c2a1cc18e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:37:31.245463 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-74eaa569-d2bd-436e-ab9d-a08c2a1cc18e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:37:31.257055 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eaa569-d2bd-436e-ab9d-a08c2a1cc18e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:37:31.258634 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eaa569-d2bd-436e-ab9d-a08c2a1cc18e service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:37:31.268465 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 837/1664] 10.222.0.107 () {60 vars in 1370 bytes} [Tue Aug 23 23:37:31 2022] GET /identity/v3/auth/tokens => generated 3318 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:37:41.264294 dv-osbrick-853458-3-iscsi devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=58 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}